Sep 22 10:49:05 devstack cinder-volume[75323]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 22 10:49:05 devstack cinder-volume[75323]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 22 10:49:05 devstack cinder-volume[75323]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 22 10:49:07 devstack cinder-volume[75323]: INFO dbcounter [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Registered counter for database cinder Sep 22 10:49:07 devstack cinder-volume[75323]: DEBUG oslo_db.sqlalchemy.engines [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75323) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 22 10:49:07 devstack cinder-volume[75323]: DEBUG dbcounter [-] [75323] Writer thread running {{(pid=75323) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 22 10:49:07 devstack cinder-volume[75323]: INFO cinder.rpc [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 22 10:49:07 devstack cinder-volume[75323]: INFO cinder.rpc [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 22 10:49:07 devstack cinder-volume[75323]: DEBUG oslo_db.sqlalchemy.engines [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75323) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 22 10:49:07 devstack cinder-volume[75323]: INFO cinder.volume.manager [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Determined volume DB was empty at startup. Sep 22 10:49:07 devstack cinder-volume[75323]: DEBUG cinder.volume.manager [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75323) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 22 10:49:07 devstack cinder-volume[75323]: INFO cinder.volume.manager [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 22 10:49:07 devstack cinder-volume[75323]: WARNING stevedore.named [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 22 10:49:07 devstack cinder-volume[75323]: WARNING castellan.key_manager [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 22 10:49:07 devstack cinder-volume[75323]: WARNING cinder.keymgr.conf_key_mgr [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 22 10:49:07 devstack cinder-volume[75323]: DEBUG cinder.volume.drivers.lvm [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75323) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Sep 22 10:49:07 devstack cinder-volume[75323]: DEBUG oslo_concurrency.processutils [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75323) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:08 devstack cinder-volume[75323]: DEBUG oslo_concurrency.processutils [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] CMD "cinder-rtstool verify" returned: 0 in 0.890s {{(pid=75323) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_db.sqlalchemy.engines [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75323) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 22 10:49:09 devstack cinder-volume[75323]: INFO cinder.rpc [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 22 10:49:09 devstack cinder-volume[75323]: INFO cinder.rpc [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 22 10:49:09 devstack cinder-volume[75323]: WARNING stevedore.named [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 22 10:49:09 devstack cinder-volume[75323]: WARNING castellan.key_manager [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 22 10:49:09 devstack cinder-volume[75323]: INFO cinder.volume.manager [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_db.sqlalchemy.engines [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75323) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 22 10:49:09 devstack cinder-volume[75323]: INFO oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Starting 1 workers Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Started child 75436 {{(pid=75323) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Full set of CONF: {{(pid=75323) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] ******************************************************************************** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Configuration options gathered from: {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] ================================================================================ {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] allow_availability_zone_fallback = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] allow_compression_on_image_upload = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] allowed_direct_url_schemes = [] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] api_rate_limit = True {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] auth_strategy = keystone {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] az_cache_duration = 3600 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_availability_zone = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_host = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_name = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_stats_polling_interval = 60 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backup_api_class = cinder.backup.api.API {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backup_name_template = backup-%s {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backup_use_same_host = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backup_use_temp_snapshot = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] chap_password = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] chap_username = {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cinder_internal_tenant_project_id = 7aa750ccf76f4d3fae97627e1cf20bc7 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cinder_internal_tenant_user_id = 962004f60a394a03a5b485d6ab9afdec {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cloned_volume_same_az = True {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cluster = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] compression_format = gzip {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75436]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0) Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] compute_api_class = cinder.compute.nova.API {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] config_dir = [] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] config_source = [] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] control_exchange = openstack {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] debug = True {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] default_availability_zone = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] default_group_type = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] default_volume_type = lvmdriver-1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] driver_client_cert = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] driver_client_cert_key = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] driver_data_namespace = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] driver_ssl_cert_path = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] driver_ssl_cert_verify = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] driver_use_ssl = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] enable_force_upload = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] enable_new_services = True {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] enable_unsupported_driver = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] enabled_backends = ['lvmdriver-1'] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] enforce_multipath_for_image_xfer = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] filter_function = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] glance_api_insecure = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] glance_api_servers = ['http://192.168.122.214/image'] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] glance_api_ssl_compression = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] glance_ca_certificates_file = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] glance_catalog_info = image:glance:publicURL {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] glance_certfile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] glance_keyfile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] glance_num_retries = 3 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] glance_request_timeout = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] goodness_function = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] graceful_shutdown_timeout = 5 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] group_api_class = cinder.group.api.API {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] host = devstack {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] image_compress_on_upload = True {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] image_conversion_address_space_limit = 1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] image_conversion_cpu_limit = 60 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] image_conversion_disable = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] image_upload_use_cinder_backend = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] image_upload_use_internal_tenant = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] image_volume_cache_enabled = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] image_volume_cache_max_count = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] image_volume_cache_max_size_gb = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] init_host_max_objects_retrieval = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] instance_format = [instance: %(uuid)s] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] iscsi_iotype = fileio {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] iscsi_target_flags = {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] iscsi_write_cache = on {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] iser_helper = tgtadm {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] iser_ip_address = 192.168.122.214 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] iser_port = 3260 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] log_color = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] log_config_append = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] log_dir = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] log_file = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] log_options = True {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] log_rotate_interval = 1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] log_rotate_interval_type = days {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] log_rotation_type = none {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] max_age = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] max_logfile_count = 30 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] max_logfile_size_mb = 200 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] max_over_subscription_ratio = 20.0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] message_reap_interval = 86400 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] message_ttl = 2592000 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] migration_create_volume_timeout_secs = 300 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] monkey_patch = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] monkey_patch_modules = [] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] my_ip = 192.168.122.214 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] no_snapshot_gb_quota = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] num_iser_scan_tries = 3 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] num_shell_tries = 3 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] num_volume_device_scan_tries = 3 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] nvmeof_conn_info_version = 1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] nvmet_ns_id = 10 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] nvmet_port_id = 1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] osapi_max_limit = 1000 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] osapi_volume_ext_list = [] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] osapi_volume_listen = 0.0.0.0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] osapi_volume_listen_port = 8776 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] osapi_volume_use_ssl = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] osapi_volume_workers = 2 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] per_volume_size_limit = -1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] periodic_fuzzy_delay = 60 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] periodic_interval = 60 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] project_id_regex = [0-9a-f\-]+ {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] public_endpoint = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] publish_errors = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] quota_backup_gigabytes = 1000 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] quota_backups = 10 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] quota_gigabytes = 1000 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] quota_groups = 10 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] quota_snapshots = 10 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] quota_volumes = 10 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] rate_limit_burst = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] rate_limit_except_level = CRITICAL {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] rate_limit_interval = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] reinit_driver_count = 3 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] replication_device = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] report_discard_supported = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] report_interval = 120 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] reservation_clean_interval = 86400 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] reservation_expire = 86400 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] reserved_image_namespaces = [] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] reserved_percentage = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] rpc_response_timeout = 120 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] run_external_periodic_tasks = True {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] scst_target_driver = iscsi {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] scst_target_iqn_name = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] service_down_time = 720 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] shell_completion = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] snapshot_name_template = snapshot-%s {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] snapshot_same_host = True {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] split_loggers = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] state_path = /opt/stack/data/cinder {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] storage_availability_zone = nova {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] storage_protocol = iSCSI {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] syslog_log_facility = LOG_USER {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] target_helper = lioadm {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] target_ip_address = 192.168.122.214 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] target_port = 3260 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] target_protocol = iscsi {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] target_secondary_ip_addresses = [] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] trace_flags = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] transfer_api_class = cinder.transfer.api.API {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] transport_url = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] until_refresh = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] use_chap_auth = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] use_default_quota_class = True {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] use_journal = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] use_json = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] use_multipath_for_image_xfer = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] use_stderr = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] use_syslog = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] verify_glance_signatures = enabled {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] volume_api_class = cinder.volume.api.API {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] volume_backend_name = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] volume_clear = zero {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] volume_clear_ionice = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] volume_clear_size = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] volume_copy_bps_limit = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] volume_dd_blocksize = 1M {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] volume_name_template = volume-%s {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] volume_service_inithost_offload = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] volume_usage_audit_period = month {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] watch_log_file = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] zoning_mode = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_concurrency.disable_process_locking = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.admin_password = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.admin_token = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.admin_user = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.auth_admin_prefix = {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.auth_port = 35357 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.auth_protocol = https {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.auth_section = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.auth_type = password {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.auth_uri = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.auth_version = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.cache = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.certfile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.delay_auth_decision = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.http_connect_timeout = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.identity_uri = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.include_service_catalog = True {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.insecure = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.interface = public {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.keyfile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.memcache_password = {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.memcache_username = {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.region_name = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.service_token_roles_required = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.service_type = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.token_cache_time = 300 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.backend = dogpile.cache.null {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.backend_argument = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.backend_expiration_time = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.config_prefix = cache.oslo {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.dead_timeout = 60.0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.debug_cache_backend = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.enable_retry_client = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.enable_socket_keepalive = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.enabled = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.enforce_fips_mode = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.expiration_time = 600 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.hashclient_retry_attempts = 2 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.hashclient_retry_delay = 1.0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.memcache_dead_retry = 300 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.memcache_password = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75436]: INFO cinder.volume.manager [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.memcache_pool_maxsize = 10 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.memcache_sasl_enabled = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.memcache_socket_timeout = 1.0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.memcache_username = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.proxies = [] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.redis_db = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.redis_password = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.redis_sentinel_service_name = mymaster {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.redis_server = localhost:6379 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.redis_socket_timeout = 1.0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.redis_username = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.retry_attempts = 2 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.retry_delay = 0.0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.socket_keepalive_count = 1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.socket_keepalive_idle = 1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.socket_keepalive_interval = 1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.tls_allowed_ciphers = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.tls_cafile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.tls_certfile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.tls_enabled = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cache.tls_keyfile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] coordination.backend_url = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.asyncio_connection = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.asyncio_slave_connection = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:09 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.backend = sqlalchemy {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.connection = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.connection_debug = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.connection_parameters = {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.connection_recycle_time = 3600 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.connection_trace = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.db_inc_retry_interval = True {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.db_max_retries = 20 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.db_max_retry_interval = 10 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.db_retry_interval = 1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.max_overflow = 50 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.max_pool_size = 5 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.max_retries = 10 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.mysql_wsrep_sync_wait = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.pool_timeout = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.retry_interval = 10 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.slave_connection = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.sqlite_synchronous = True {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] database.use_db_reconnect = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] profiler.connection_string = messaging:// {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] profiler.enabled = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] profiler.es_doc_type = notification {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] profiler.es_scroll_size = 10000 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] profiler.es_scroll_time = 2m {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] profiler.filter_error_trace = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] profiler.hmac_keys = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] profiler.sentinel_service_name = mymaster {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] profiler.socket_timeout = 0.1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] profiler.trace_requests = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] profiler.trace_sqlalchemy = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] profiler_jaeger.process_tags = {} {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] profiler_jaeger.service_name_prefix = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] profiler_otlp.service_name_prefix = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_policy.enforce_new_defaults = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: WARNING oslo_config.cfg [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_policy.enforce_scope = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_policy.policy_default_rule = default {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_policy.policy_file = policy.yaml {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_policy.remote_timeout = 60.0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] privsep_osbrick.group = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] privsep_osbrick.helper_command = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] privsep_osbrick.user = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cinder_sys_admin.group = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cinder_sys_admin.helper_command = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] cinder_sys_admin.user = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] service_user.auth_section = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] service_user.auth_type = password {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] service_user.certfile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] service_user.collect_timing = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] service_user.insecure = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] service_user.keyfile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] service_user.send_service_user_token = True {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] service_user.split_loggers = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] service_user.timeout = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] glance.auth_section = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] glance.auth_type = password {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] glance.certfile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] glance.collect_timing = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] glance.insecure = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] glance.keyfile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] glance.split_loggers = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] glance.timeout = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.backend_availability_zone = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.chap_password = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.chap_username = {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.driver_client_cert = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.driver_client_cert_key = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.driver_data_namespace = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.driver_use_ssl = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.enable_unsupported_driver = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.extra_capabilities = {} {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.filter_function = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.goodness_function = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.iscsi_iotype = fileio {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.iscsi_target_flags = {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.iscsi_write_cache = on {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.iser_helper = tgtadm {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.iser_ip_address = 192.168.122.214 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.iser_port = 3260 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.lvm_mirrors = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.lvm_share_target = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.lvm_type = auto {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.num_shell_tries = 3 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.nvmet_port_id = 1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.replication_device = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.report_discard_supported = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.reserved_percentage = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.scst_target_driver = iscsi {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.scst_target_iqn_name = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.storage_protocol = iSCSI {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.target_helper = tgtadm {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.target_ip_address = 192.168.122.214 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.target_port = 3260 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.target_protocol = iscsi {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.trace_flags = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.unique_fqdn_network = True {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.use_chap_auth = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.volume_backend_name = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.volume_clear = zero {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.volume_clear_ionice = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.volume_clear_size = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.volume_group = cinder-volumes {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_reports.file_event_handler = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_reports.log_dir = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.backend_availability_zone = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.backend_host = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.178s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.chap_password = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.chap_username = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.chiscsi_conf = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.driver_client_cert = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.driver_data_namespace = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.driver_use_ssl = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.extra_capabilities = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.filter_function = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.goodness_function = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.iscsi_iotype = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.iser_helper = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.iser_ip_address = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.iser_port = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.iser_target_prefix = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.lvm_conf_file = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.lvm_mirrors = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.lvm_share_target = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.lvm_type = auto {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.num_shell_tries = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.nvmet_port_id = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.replication_device = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.report_discard_supported = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.reserved_percentage = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.scst_target_driver = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.storage_protocol = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.target_helper = lioadm {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.target_ip_address = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.target_port = 3260 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.target_protocol = iscsi {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.trace_flags = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.use_chap_auth = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.volume_clear = zero {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.volume_clear_size = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] lvmdriver-1.volumes_dir = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.ssl = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.ssl_version = {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_notifications.driver = [] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_notifications.retry = -1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] oslo_messaging_notifications.transport_url = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] key_manager.fixed_key = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican.barbican_api_version = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican.barbican_endpoint = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican.barbican_endpoint_type = public {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican.barbican_region_name = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican.cafile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican.certfile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican.collect_timing = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican.insecure = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican.keyfile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican.number_of_retries = 60 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican.retry_delay = 1 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican.send_service_user_token = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican.split_loggers = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican.timeout = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican.verify_ssl = True {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican.verify_ssl_path = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican_service_user.auth_section = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican_service_user.auth_type = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican_service_user.cafile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican_service_user.certfile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican_service_user.collect_timing = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican_service_user.insecure = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican_service_user.keyfile = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican_service_user.split_loggers = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] barbican_service_user.timeout = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] vault.approle_role_id = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] vault.approle_secret_id = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] vault.kv_mountpoint = secret {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] vault.kv_path = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] vault.kv_version = 2 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] vault.namespace = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] vault.root_token_id = **** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] vault.ssl_ca_crt_file = None {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] vault.timeout = 60.0 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] vault.use_ssl = False {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:49:10 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] ******************************************************************************** {{(pid=75323) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 22 10:49:10 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.149s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:10 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:10 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.085s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:10 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:10 devstack sudo[75496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 22 10:49:10 devstack sudo[75496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:12 devstack sudo[75496]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:12 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 1.898s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:12 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:12 devstack sudo[75614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 10:49:12 devstack sudo[75614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:14 devstack sudo[75614]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:14 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 1.901s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:14 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 10:49:14 devstack cinder-volume[75436]: INFO cinder.brick.local_dev.lvm [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 22 10:49:14 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:14 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.083s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:14 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:14 devstack sudo[75709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 10:49:14 devstack sudo[75709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:16 devstack sudo[75709]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:16 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.910s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:16 devstack cinder-volume[75436]: DEBUG cinder.brick.local_dev.lvm [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75436) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Sep 22 10:49:16 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:16 devstack sudo[75805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 10:49:16 devstack sudo[75805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:19 devstack cinder-volume[75323]: DEBUG dbcounter [-] [75323] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75323) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:49:19 devstack sudo[75805]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:19 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.187s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:19 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:19 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.105s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:19 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:19 devstack sudo[75992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 10:49:19 devstack sudo[75992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:21 devstack sudo[75992]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:21 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.947s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:21 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:21 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.073s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:21 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:21 devstack sudo[76025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 22 10:49:21 devstack sudo[76025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:23 devstack sudo[76025]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:23 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 1.983s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:23 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:23 devstack sudo[76063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 10:49:23 devstack sudo[76063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:26 devstack sudo[76063]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:26 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.730s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:26 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:26 devstack sudo[76151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 10:49:26 devstack sudo[76151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:28 devstack sudo[76151]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:28 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.251s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:28 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:28 devstack sudo[76154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 10:49:28 devstack sudo[76154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:31 devstack sudo[76154]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:31 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.723s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:31 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:31 devstack sudo[76160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 10:49:31 devstack sudo[76160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:34 devstack sudo[76160]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:34 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.477s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:34 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:34 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.108s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:34 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:34 devstack sudo[76166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 10:49:34 devstack sudo[76166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:36 devstack sudo[76166]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:36 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.121s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:36 devstack cinder-volume[75436]: INFO cinder.volume.drivers.lvm [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 22 10:49:36 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:36 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.085s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:36 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:36 devstack sudo[76214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 10:49:36 devstack sudo[76214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:38 devstack sudo[76214]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:38 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.851s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:38 devstack cinder-volume[75436]: DEBUG cinder.volume.drivers.lvm [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Updating volume stats {{(pid=75436) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 22 10:49:38 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:38 devstack sudo[76288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 10:49:38 devstack sudo[76288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:40 devstack sudo[76288]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:40 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.966s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:40 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:40 devstack sudo[76438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 10:49:40 devstack sudo[76438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:42 devstack sudo[76438]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:42 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.235s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:42 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:42 devstack sudo[76464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 10:49:42 devstack sudo[76464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:44 devstack sudo[76464]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:44 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.249s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:44 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:45 devstack sudo[76468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 10:49:45 devstack sudo[76468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:46 devstack sudo[76468]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:46 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.998s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:46 devstack cinder-volume[75436]: INFO cinder.volume.driver [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Driver hasn't implemented _init_vendor_properties() Sep 22 10:49:46 devstack cinder-volume[75436]: DEBUG cinder.volume.driver [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75436) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 22 10:49:47 devstack cinder-volume[75436]: DEBUG oslo_db.sqlalchemy.engines [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75436) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 22 10:49:47 devstack cinder-volume[75436]: DEBUG dbcounter [-] [75436] Writer thread running {{(pid=75436) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 22 10:49:47 devstack cinder-volume[75436]: DEBUG cinder.db.sqlalchemy.api [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Building query based on filter {{(pid=75436) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3918}} Sep 22 10:49:47 devstack cinder-volume[75436]: DEBUG cinder.image.image_utils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75436) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 22 10:49:47 devstack cinder-volume[75436]: INFO cinder.keymgr.migration [None req-d5cf1d84-f9f2-485b-8fe0-f293fa047247 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 22 10:49:47 devstack cinder-volume[75436]: DEBUG cinder.volume.drivers.lvm [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Updating volume stats {{(pid=75436) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 22 10:49:47 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:47 devstack sudo[76477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 10:49:47 devstack sudo[76477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:49 devstack sudo[76477]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:49 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.907s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:49 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:49 devstack sudo[76519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 10:49:49 devstack sudo[76519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:51 devstack sudo[76519]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:51 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.150s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:51 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:51 devstack sudo[76629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 10:49:51 devstack sudo[76629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:53 devstack sudo[76629]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:53 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.938s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:53 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:53 devstack sudo[76632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 10:49:53 devstack sudo[76632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:55 devstack sudo[76632]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:55 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.901s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:55 devstack cinder-volume[75436]: DEBUG cinder.manager [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Notifying Schedulers of capabilities ... {{(pid=75436) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 10:49:55 devstack cinder-volume[75436]: INFO cinder.volume.manager [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Driver initialization completed successfully. Sep 22 10:49:55 devstack cinder-volume[75436]: INFO cinder.manager [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Initiating service 2 cleanup Sep 22 10:49:55 devstack cinder-volume[75436]: INFO cinder.manager [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Service 2 cleanup completed. Sep 22 10:49:55 devstack cinder-volume[75436]: DEBUG cinder.service [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Creating RPC server for service cinder-volume {{(pid=75436) start /opt/stack/cinder/cinder/service.py:239}} Sep 22 10:49:55 devstack cinder-volume[75436]: DEBUG cinder.service [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75436) start /opt/stack/cinder/cinder/service.py:245}} Sep 22 10:49:55 devstack cinder-volume[75436]: INFO cinder.volume.manager [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 22 10:49:55 devstack cinder-volume[75436]: DEBUG cinder.volume.drivers.lvm [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Updating volume stats {{(pid=75436) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 22 10:49:55 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:55 devstack sudo[76635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 10:49:55 devstack sudo[76635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:57 devstack sudo[76635]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:57 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.813s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:57 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:57 devstack sudo[76643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 10:49:57 devstack sudo[76643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:49:59 devstack sudo[76643]: pam_unix(sudo:session): session closed for user root Sep 22 10:49:59 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.182s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:49:59 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:49:59 devstack sudo[76647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 10:49:59 devstack sudo[76647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:50:02 devstack sudo[76647]: pam_unix(sudo:session): session closed for user root Sep 22 10:50:02 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.227s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:50:02 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:50:02 devstack sudo[76655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 10:50:02 devstack sudo[76655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:50:03 devstack sudo[76655]: pam_unix(sudo:session): session closed for user root Sep 22 10:50:03 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.709s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:50:03 devstack cinder-volume[75436]: INFO cinder.volume.manager [None req-d21543ea-223e-4175-adeb-dd3c2136c1bb None None] Driver post RPC initialization completed successfully. Sep 22 10:50:13 devstack cinder-volume[75436]: DEBUG dbcounter [-] [75436] Writing DB stats cinder:SELECT=3 {{(pid=75436) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:50:13 devstack cinder-volume[75436]: DEBUG dbcounter [-] [75436] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75436) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:50:38 devstack cinder-volume[75436]: DEBUG oslo_service.periodic_task [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75436) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 10:50:38 devstack cinder-volume[75436]: DEBUG cinder.volume.drivers.lvm [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Updating volume stats {{(pid=75436) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 22 10:50:38 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:50:38 devstack sudo[77589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 10:50:38 devstack sudo[77589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:50:39 devstack sudo[77589]: pam_unix(sudo:session): session closed for user root Sep 22 10:50:39 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.882s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:50:39 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:50:40 devstack sudo[77595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 10:50:40 devstack sudo[77595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:50:41 devstack sudo[77595]: pam_unix(sudo:session): session closed for user root Sep 22 10:50:42 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.077s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:50:42 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:50:42 devstack sudo[77613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 10:50:42 devstack sudo[77613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:50:44 devstack sudo[77613]: pam_unix(sudo:session): session closed for user root Sep 22 10:50:44 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.157s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:50:44 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:50:44 devstack sudo[77636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 10:50:44 devstack sudo[77636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:50:46 devstack sudo[77636]: pam_unix(sudo:session): session closed for user root Sep 22 10:50:46 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.124s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:50:46 devstack cinder-volume[75436]: DEBUG cinder.manager [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Notifying Schedulers of capabilities ... {{(pid=75436) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 10:51:38 devstack cinder-volume[75436]: DEBUG oslo_service.periodic_task [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75436) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 10:51:38 devstack cinder-volume[75436]: DEBUG cinder.volume.drivers.lvm [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Updating volume stats {{(pid=75436) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 22 10:51:38 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:51:38 devstack sudo[78330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 10:51:38 devstack sudo[78330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:51:39 devstack sudo[78330]: pam_unix(sudo:session): session closed for user root Sep 22 10:51:40 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.982s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:51:40 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:51:40 devstack sudo[78334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 10:51:40 devstack sudo[78334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:51:41 devstack sudo[78334]: pam_unix(sudo:session): session closed for user root Sep 22 10:51:41 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.879s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:51:41 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:51:42 devstack sudo[78337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 10:51:42 devstack sudo[78337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:51:43 devstack sudo[78337]: pam_unix(sudo:session): session closed for user root Sep 22 10:51:43 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.038s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:51:44 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:51:44 devstack sudo[78402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 10:51:44 devstack sudo[78402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:51:46 devstack sudo[78402]: pam_unix(sudo:session): session closed for user root Sep 22 10:51:46 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.160s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:51:46 devstack cinder-volume[75436]: DEBUG cinder.manager [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Notifying Schedulers of capabilities ... {{(pid=75436) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 10:52:14 devstack cinder-volume[75436]: DEBUG dbcounter [-] [75436] Writing DB stats cinder:SELECT=1 {{(pid=75436) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:52:14 devstack cinder-volume[75436]: DEBUG dbcounter [-] [75436] Writing DB stats cinder:UPDATE=1 {{(pid=75436) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:52:38 devstack cinder-volume[75436]: DEBUG oslo_service.periodic_task [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75436) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 10:52:38 devstack cinder-volume[75436]: DEBUG cinder.volume.drivers.lvm [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Updating volume stats {{(pid=75436) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 22 10:52:38 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:52:38 devstack sudo[79724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 10:52:38 devstack sudo[79724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:52:40 devstack sudo[79724]: pam_unix(sudo:session): session closed for user root Sep 22 10:52:40 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.034s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:52:40 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:52:40 devstack sudo[79873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 10:52:40 devstack sudo[79873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:52:42 devstack sudo[79873]: pam_unix(sudo:session): session closed for user root Sep 22 10:52:42 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.038s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:52:42 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:52:42 devstack sudo[80020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 10:52:42 devstack sudo[80020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:52:44 devstack sudo[80020]: pam_unix(sudo:session): session closed for user root Sep 22 10:52:44 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.120s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:52:44 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:52:44 devstack sudo[80180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 10:52:44 devstack sudo[80180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:52:46 devstack sudo[80180]: pam_unix(sudo:session): session closed for user root Sep 22 10:52:46 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.430s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:52:46 devstack cinder-volume[75436]: DEBUG cinder.manager [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Notifying Schedulers of capabilities ... {{(pid=75436) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 10:53:38 devstack cinder-volume[75436]: DEBUG oslo_service.periodic_task [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75436) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 10:53:38 devstack cinder-volume[75436]: DEBUG cinder.volume.drivers.lvm [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Updating volume stats {{(pid=75436) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 22 10:53:38 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:53:38 devstack sudo[81611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 10:53:38 devstack sudo[81611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:53:39 devstack sudo[81611]: pam_unix(sudo:session): session closed for user root Sep 22 10:53:39 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.909s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:53:39 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:53:40 devstack sudo[81659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 10:53:40 devstack sudo[81659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:53:41 devstack sudo[81659]: pam_unix(sudo:session): session closed for user root Sep 22 10:53:41 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.869s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:53:41 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:53:41 devstack sudo[81666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 10:53:41 devstack sudo[81666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:53:43 devstack sudo[81666]: pam_unix(sudo:session): session closed for user root Sep 22 10:53:43 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.070s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:53:43 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:53:44 devstack sudo[81673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 10:53:44 devstack sudo[81673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:53:45 devstack sudo[81673]: pam_unix(sudo:session): session closed for user root Sep 22 10:53:45 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.001s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:53:45 devstack cinder-volume[75436]: DEBUG cinder.manager [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Notifying Schedulers of capabilities ... {{(pid=75436) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 10:54:14 devstack cinder-volume[75436]: DEBUG dbcounter [-] [75436] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75436) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:54:38 devstack cinder-volume[75436]: DEBUG oslo_service.periodic_task [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75436) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 10:54:38 devstack cinder-volume[75436]: DEBUG cinder.volume.drivers.lvm [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Updating volume stats {{(pid=75436) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 22 10:54:38 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:54:38 devstack sudo[81876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 22 10:54:38 devstack sudo[81876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:54:39 devstack sudo[81876]: pam_unix(sudo:session): session closed for user root Sep 22 10:54:39 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.903s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:54:39 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:54:40 devstack sudo[81881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 10:54:40 devstack sudo[81881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:54:41 devstack sudo[81881]: pam_unix(sudo:session): session closed for user root Sep 22 10:54:42 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.053s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:54:42 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:54:42 devstack sudo[81886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 22 10:54:42 devstack sudo[81886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:54:43 devstack sudo[81886]: pam_unix(sudo:session): session closed for user root Sep 22 10:54:43 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.851s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:54:43 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:54:43 devstack sudo[81892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 22 10:54:43 devstack sudo[81892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:54:45 devstack sudo[81892]: pam_unix(sudo:session): session closed for user root Sep 22 10:54:45 devstack cinder-volume[75436]: DEBUG oslo_concurrency.processutils [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.880s {{(pid=75436) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:54:45 devstack cinder-volume[75436]: DEBUG cinder.manager [None req-5e0cc4c1-09dc-4ff4-a1c9-106f662a542b None None] Notifying Schedulers of capabilities ... {{(pid=75436) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 10:55:29 devstack cinder-volume[75323]: INFO oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Caught SIGTERM, stopping children Sep 22 10:55:29 devstack cinder-volume[75323]: DEBUG oslo_concurrency.lockutils [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Acquiring lock "singleton_lock" {{(pid=75323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 22 10:55:29 devstack cinder-volume[75323]: DEBUG oslo_concurrency.lockutils [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Acquired lock "singleton_lock" {{(pid=75323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 22 10:55:29 devstack cinder-volume[75323]: DEBUG oslo_concurrency.lockutils [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Releasing lock "singleton_lock" {{(pid=75323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 22 10:55:29 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Stop services. {{(pid=75323) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}} Sep 22 10:55:29 devstack cinder-volume[75323]: DEBUG oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Killing children. {{(pid=75323) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}} Sep 22 10:55:29 devstack cinder-volume[75323]: INFO oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Waiting on 1 children to exit Sep 22 10:55:30 devstack cinder-volume[75436]: DEBUG oslo_concurrency.lockutils [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Acquiring lock "singleton_lock" {{(pid=75436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 22 10:55:30 devstack cinder-volume[75436]: DEBUG oslo_concurrency.lockutils [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Acquired lock "singleton_lock" {{(pid=75436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 22 10:55:30 devstack cinder-volume[75436]: DEBUG oslo_concurrency.lockutils [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Releasing lock "singleton_lock" {{(pid=75436) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 22 10:55:30 devstack cinder-volume[75436]: WARNING amqp [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 22 10:55:30 devstack cinder-volume[75436]: WARNING amqp [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 22 10:55:30 devstack cinder-volume[75323]: INFO oslo_service.backend._eventlet.service [None req-b8a8bc5d-c7c1-4b6d-a692-a8429643b93e None None] Child 75436 exited with status 0 Sep 22 10:55:50 devstack cinder-volume[83066]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 22 10:55:50 devstack cinder-volume[83066]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 22 10:55:50 devstack cinder-volume[83066]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 22 10:55:53 devstack cinder-volume[83066]: INFO dbcounter [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] Registered counter for database cinder Sep 22 10:55:53 devstack cinder-volume[83066]: DEBUG oslo_db.sqlalchemy.engines [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83066) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 22 10:55:53 devstack cinder-volume[83066]: DEBUG dbcounter [-] [83066] Writer thread running {{(pid=83066) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 22 10:55:53 devstack cinder-volume[83066]: INFO cinder.rpc [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 22 10:55:53 devstack cinder-volume[83066]: INFO cinder.rpc [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 22 10:55:53 devstack cinder-volume[83066]: DEBUG oslo_db.sqlalchemy.engines [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83066) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 22 10:55:54 devstack cinder-volume[83066]: INFO cinder.volume.manager [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] Determined volume DB was empty at startup. Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG cinder.volume.manager [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83066) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 22 10:55:54 devstack cinder-volume[83066]: INFO cinder.volume.manager [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 22 10:55:54 devstack cinder-volume[83066]: WARNING stevedore.named [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 22 10:55:54 devstack cinder-volume[83066]: WARNING castellan.key_manager [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 22 10:55:54 devstack cinder-volume[83066]: WARNING cinder.keymgr.conf_key_mgr [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 22 10:55:54 devstack cinder-volume[83066]: INFO cinder.volume.manager [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_db.sqlalchemy.engines [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83066) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 22 10:55:54 devstack cinder-volume[83066]: INFO oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] Starting 1 workers Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] Started child 83310 {{(pid=83066) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] Full set of CONF: {{(pid=83066) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] ******************************************************************************** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] Configuration options gathered from: {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] ================================================================================ {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] allow_availability_zone_fallback = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] allow_compression_on_image_upload = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] allowed_direct_url_schemes = [] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] api_rate_limit = True {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] auth_strategy = keystone {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_availability_zone = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_host = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_name = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_stats_polling_interval = 60 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backup_api_class = cinder.backup.api.API {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backup_name_template = backup-%s {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backup_use_same_host = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backup_use_temp_snapshot = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] chap_password = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] chap_username = {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cinder_internal_tenant_project_id = 7aa750ccf76f4d3fae97627e1cf20bc7 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cinder_internal_tenant_user_id = 962004f60a394a03a5b485d6ab9afdec {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cluster = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] compression_format = gzip {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] compute_api_class = cinder.compute.nova.API {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] config_dir = [] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83310]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0) Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] config_source = [] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] control_exchange = openstack {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] debug = True {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] default_availability_zone = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] default_group_type = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] default_volume_type = QuobyteHD {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] driver_client_cert = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] driver_client_cert_key = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] driver_data_namespace = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] driver_ssl_cert_path = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] driver_ssl_cert_verify = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] driver_use_ssl = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] enable_new_services = True {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] enable_unsupported_driver = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] enabled_backends = ['QuobyteHD'] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] enforce_multipath_for_image_xfer = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] filter_function = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] glance_api_insecure = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] glance_api_servers = ['http://192.168.122.214/image'] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] glance_api_ssl_compression = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] glance_ca_certificates_file = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] glance_catalog_info = image:glance:publicURL {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] glance_certfile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] glance_keyfile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] glance_num_retries = 3 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] glance_request_timeout = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] goodness_function = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] graceful_shutdown_timeout = 5 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] group_api_class = cinder.group.api.API {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] host = devstack {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] image_compress_on_upload = True {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] image_conversion_address_space_limit = 1 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] image_conversion_cpu_limit = 60 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] image_conversion_disable = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] image_upload_use_cinder_backend = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] image_upload_use_internal_tenant = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] image_volume_cache_enabled = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] image_volume_cache_max_count = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] image_volume_cache_max_size_gb = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] init_host_max_objects_retrieval = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] instance_format = [instance: %(uuid)s] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] iscsi_iotype = fileio {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] iscsi_target_flags = {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] iscsi_write_cache = on {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] iser_helper = tgtadm {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] iser_ip_address = 192.168.122.214 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] iser_port = 3260 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] log_color = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] log_config_append = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] log_dir = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] log_file = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] log_options = True {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] log_rotate_interval = 1 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] log_rotate_interval_type = days {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] log_rotation_type = none {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] max_age = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] max_logfile_count = 30 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] max_logfile_size_mb = 200 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] max_over_subscription_ratio = 20.0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] message_reap_interval = 86400 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] message_ttl = 2592000 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] migration_create_volume_timeout_secs = 300 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] monkey_patch = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] monkey_patch_modules = [] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] my_ip = 192.168.122.214 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] no_snapshot_gb_quota = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] num_iser_scan_tries = 3 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] num_shell_tries = 3 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] num_volume_device_scan_tries = 3 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] nvmeof_conn_info_version = 1 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] nvmet_ns_id = 10 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] nvmet_port_id = 1 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] osapi_max_limit = 1000 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] osapi_volume_ext_list = [] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] osapi_volume_listen_port = 8776 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] osapi_volume_use_ssl = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] osapi_volume_workers = 2 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] per_volume_size_limit = -1 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] periodic_fuzzy_delay = 60 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] periodic_interval = 60 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] public_endpoint = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] publish_errors = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] quota_backup_gigabytes = 1000 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] quota_backups = 10 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] quota_gigabytes = 1000 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] quota_groups = 10 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] quota_snapshots = 10 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] quota_volumes = 10 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] rate_limit_burst = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] rate_limit_except_level = CRITICAL {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] rate_limit_interval = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] reinit_driver_count = 3 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] replication_device = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] report_discard_supported = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] report_interval = 120 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] reservation_clean_interval = 86400 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] reservation_expire = 86400 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] reserved_image_namespaces = [] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] reserved_percentage = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] rpc_response_timeout = 120 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] run_external_periodic_tasks = True {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] scst_target_driver = iscsi {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] scst_target_iqn_name = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] service_down_time = 720 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] shell_completion = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] snapshot_name_template = snapshot-%s {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] split_loggers = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] state_path = /opt/stack/data/cinder {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] storage_availability_zone = nova {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] storage_protocol = iSCSI {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] syslog_log_facility = LOG_USER {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] target_helper = lioadm {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] target_ip_address = 192.168.122.214 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] target_port = 3260 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] target_protocol = iscsi {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] target_secondary_ip_addresses = [] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] trace_flags = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] transport_url = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] until_refresh = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] use_chap_auth = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] use_default_quota_class = True {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] use_journal = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] use_json = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] use_multipath_for_image_xfer = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] use_stderr = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] use_syslog = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] verify_glance_signatures = enabled {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] volume_api_class = cinder.volume.api.API {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] volume_backend_name = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] volume_clear = zero {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] volume_clear_ionice = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] volume_clear_size = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] volume_copy_bps_limit = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] volume_dd_blocksize = 1M {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] volume_name_template = volume-%s {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] volume_service_inithost_offload = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] volume_usage_audit_period = month {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] watch_log_file = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] zoning_mode = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_concurrency.disable_process_locking = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.admin_password = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.admin_token = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.admin_user = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.auth_port = 35357 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.auth_protocol = https {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.auth_section = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.auth_type = password {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.auth_uri = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.auth_version = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.cache = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.certfile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.identity_uri = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.include_service_catalog = True {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.insecure = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.interface = public {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.keyfile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.memcache_password = {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.memcache_username = {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.region_name = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.service_type = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.backend = dogpile.cache.null {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.backend_argument = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.backend_expiration_time = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.config_prefix = cache.oslo {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.dead_timeout = 60.0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.debug_cache_backend = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.enable_retry_client = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.enable_socket_keepalive = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.enabled = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.enforce_fips_mode = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.expiration_time = 600 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.hashclient_retry_attempts = 2 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.hashclient_retry_delay = 1.0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.memcache_dead_retry = 300 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.memcache_password = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.memcache_pool_maxsize = 10 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.memcache_sasl_enabled = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.memcache_socket_timeout = 1.0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.memcache_username = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.proxies = [] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.redis_db = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.redis_password = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.redis_server = localhost:6379 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.redis_socket_timeout = 1.0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Starting volume driver QuobyteDriver (1.1.13) Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.redis_username = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.retry_attempts = 2 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.retry_delay = 0.0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.socket_keepalive_count = 1 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.socket_keepalive_idle = 1 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.socket_keepalive_interval = 1 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.tls_allowed_ciphers = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.tls_cafile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.tls_certfile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.tls_enabled = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cache.tls_keyfile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] coordination.backend_url = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=83310) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.asyncio_connection = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.asyncio_slave_connection = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.backend = sqlalchemy {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.connection = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.connection_debug = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.connection_parameters = {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.connection_recycle_time = 3600 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.connection_trace = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.db_inc_retry_interval = True {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.db_max_retries = 20 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.db_max_retry_interval = 10 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.db_retry_interval = 1 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.max_overflow = 50 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.max_pool_size = 5 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.max_retries = 10 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.mysql_wsrep_sync_wait = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.pool_timeout = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.retry_interval = 10 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.slave_connection = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.sqlite_synchronous = True {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] database.use_db_reconnect = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] profiler.connection_string = messaging:// {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] profiler.enabled = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] profiler.es_doc_type = notification {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] profiler.es_scroll_size = 10000 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] profiler.es_scroll_time = 2m {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] profiler.filter_error_trace = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] profiler.hmac_keys = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] profiler.sentinel_service_name = mymaster {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] profiler.socket_timeout = 0.1 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] profiler.trace_requests = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] profiler.trace_sqlalchemy = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] profiler_jaeger.process_tags = {} {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] profiler_jaeger.service_name_prefix = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] profiler_otlp.service_name_prefix = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_policy.enforce_new_defaults = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: WARNING oslo_config.cfg [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_policy.enforce_scope = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_policy.policy_default_rule = default {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_policy.policy_file = policy.yaml {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] privsep_osbrick.group = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] privsep_osbrick.helper_command = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] privsep_osbrick.user = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cinder_sys_admin.group = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cinder_sys_admin.helper_command = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] cinder_sys_admin.user = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] service_user.auth_section = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] service_user.auth_type = password {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] service_user.certfile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] service_user.collect_timing = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] service_user.insecure = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] service_user.keyfile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] service_user.send_service_user_token = True {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] service_user.split_loggers = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] service_user.timeout = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] glance.auth_section = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] glance.auth_type = password {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] glance.certfile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] glance.collect_timing = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] glance.insecure = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] glance.keyfile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] glance.split_loggers = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] glance.timeout = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.backend_availability_zone = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.chap_password = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.chap_username = {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.driver_client_cert = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.driver_client_cert_key = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.driver_data_namespace = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.driver_use_ssl = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.extra_capabilities = {} {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.filter_function = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.goodness_function = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.iscsi_iotype = fileio {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.iscsi_target_flags = {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.iscsi_write_cache = on {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.iser_helper = tgtadm {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.iser_ip_address = 192.168.122.214 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.iser_port = 3260 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.nas_host = {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.nas_login = admin {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.nas_mount_options = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.nas_password = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.nas_private_key = {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.nas_share_path = {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.num_shell_tries = 3 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.quobyte_volume_url = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.replication_device = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.report_discard_supported = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.reserved_percentage = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.target_helper = tgtadm {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.target_ip_address = 192.168.122.214 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.target_port = 3260 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.target_protocol = iscsi {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.trace_flags = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.unique_fqdn_network = True {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.use_chap_auth = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.volume_backend_name = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.volume_clear = zero {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.volume_clear_ionice = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.volume_clear_size = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_reports.file_event_handler = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_reports.log_dir = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.backend_availability_zone = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.backend_host = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.chap_password = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.chap_username = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.chiscsi_conf = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.driver_client_cert = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.driver_data_namespace = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.driver_use_ssl = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.extra_capabilities = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.filter_function = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.goodness_function = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.iscsi_iotype = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.iser_helper = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.iser_ip_address = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.iser_port = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.iser_target_prefix = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.nas_host = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.nas_login = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.nas_mount_options = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.nas_password = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.nas_private_key = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.nas_share_path = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.nas_ssh_port = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.num_shell_tries = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.nvmet_port_id = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.quobyte_volume_url = quobyte://10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.replication_device = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.report_discard_supported = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.reserved_percentage = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.scst_target_driver = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.storage_protocol = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.target_helper = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.target_ip_address = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.target_port = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.target_prefix = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.target_protocol = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.trace_flags = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.use_chap_auth = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.volume_clear = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.volume_clear_size = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] QuobyteHD.volumes_dir = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.ssl = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_notifications.driver = [] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_notifications.retry = -1 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] key_manager.fixed_key = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican.barbican_api_version = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican.barbican_endpoint = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican.barbican_endpoint_type = public {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican.barbican_region_name = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican.cafile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican.certfile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican.collect_timing = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican.insecure = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican.keyfile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican.number_of_retries = 60 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican.retry_delay = 1 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican.send_service_user_token = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican.split_loggers = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican.timeout = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican.verify_ssl = True {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican.verify_ssl_path = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican_service_user.auth_section = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican_service_user.auth_type = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican_service_user.cafile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican_service_user.certfile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican_service_user.collect_timing = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican_service_user.insecure = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican_service_user.keyfile = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican_service_user.split_loggers = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] barbican_service_user.timeout = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] vault.approle_role_id = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] vault.approle_secret_id = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] vault.kv_mountpoint = secret {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] vault.kv_path = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] vault.kv_version = 2 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] vault.namespace = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] vault.root_token_id = **** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] vault.ssl_ca_crt_file = None {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] vault.timeout = 60.0 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] vault.use_ssl = False {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 22 10:55:54 devstack cinder-volume[83066]: DEBUG oslo_service.backend._eventlet.service [None req-46340d15-b571-4edd-b5ff-a4fcb95629c9 None None] ******************************************************************************** {{(pid=83066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 22 10:55:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=83310) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Sep 22 10:55:54 devstack cinder-volume[83310]: INFO cinder.volume.drivers.quobyte [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual. Sep 22 10:55:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Running cmd (subprocess): mount.quobyte {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:55:55 devstack quobyte-client[83311]: Reading configuration file: /etc/quobyte/client.cfg Sep 22 10:55:55 devstack quobyte-client[83311]: Invalid parameters found, error: missing mount point. Sep 22 10:55:55 devstack quobyte-client[83311]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 22 10:55:55 devstack quobyte-client[83311]: Failed to parse all commandline parameters, please use -h/--help to see available options. Sep 22 10:55:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] CMD "mount.quobyte" returned: 1 in 0.228s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:55:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 10:55:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 10:55:55 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 10:55:55 devstack cinder-volume[83310]: INFO cinder.volume.drivers.quobyte [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Mounting volume: 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c ... Sep 22 10:55:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 -c /etc/quobyte/client-cinder.cfg {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:55:55 devstack quobyte-client[83312]: Reading configuration file: /etc/quobyte/client-cinder.cfg Sep 22 10:55:55 devstack quobyte-client[83312]: Reading configuration file: /etc/quobyte/client.cfg Sep 22 10:55:55 devstack quobyte-client[83312]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733' to display the log. Sep 22 10:55:55 devstack quobyte-client[83313]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic). Sep 22 10:55:55 devstack quobyte-client[83313]: mount.quobyte 3.25 (4fbbd59204) Sep 22 10:55:55 devstack quobyte-client[83313]: Client UUID: ZB9Kpq93-PgeB-22Ny-6L0g-GeoYikiEvDA8 Sep 22 10:55:55 devstack quobyte-client[83313]: Registry: osci01.corp.quobyte.com:7861 Sep 22 10:55:55 devstack quobyte-client[83313]: Volume: cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 10:55:55 devstack quobyte-client[83313]: FUSE version: 316 Sep 22 10:55:55 devstack quobyte-client[83313]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps) Sep 22 10:55:55 devstack quobyte-client[83313]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied Sep 22 10:55:55 devstack quobyte-client[83313]: Setting total object cache size to 3352297472 bytes Sep 22 10:55:55 devstack quobyte-client[83313]: Using FUSE low-level API Sep 22 10:55:55 devstack quobyte-client[83313]: Caching of uid/gid to user/group name mappings is enabled Sep 22 10:55:55 devstack quobyte-client[83313]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10 Sep 22 10:55:55 devstack quobyte-client[83313]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab. Sep 22 10:55:55 devstack quobyte-client[83313]: HTTP server started on port 55000 Sep 22 10:55:55 devstack quobyte-client[83313]: Caching mappings from uid/gid to user/group name and group membership temporarily. Sep 22 10:55:55 devstack quobyte-client[83313]: Mount point /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 established Sep 22 10:55:55 devstack quobyte-client[83313]: TimeSync is running and remote sync every 60 seconds Sep 22 10:55:55 devstack quobyte-client[83313]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 22 10:55:55 devstack quobyte-client[83313]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 22 10:55:55 devstack quobyte-client[83313]: Opening volume cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c (c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6) Sep 22 10:55:55 devstack quobyte-client[83313]: Setting metadata cache size to 500000 based on available system memory of 16 GiB Sep 22 10:55:55 devstack quobyte-client[83313]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 22 10:55:55 devstack quobyte-client[83313]: Changed metadata cache configuration for volume c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6 to cache_ttl_ms: 0 negative_cache_ttl_ms: 0 enable_write_back_cache: false Sep 22 10:55:55 devstack quobyte-client[83313]: Failed to invalidate inode: 38: Function not implemented Sep 22 10:55:55 devstack quobyte-client[83313]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 22 10:55:55 devstack quobyte-client[83313]: Automatic minidump upload enabled by global system configuration Sep 22 10:55:55 devstack quobyte-client[83313]: Announcing HTTP status server address 172.24.4.1 Sep 22 10:55:55 devstack quobyte-client[83313]: Registered as service (uuid ZB9Kpq93-PgeB-22Ny-6L0g-GeoYikiEvDA8) Sep 22 10:55:55 devstack quobyte-client[83313]: Quobyte Client running as pid 83313 Sep 22 10:55:55 devstack quobyte-client[83313]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2 Sep 22 10:55:55 devstack quobyte-client[83313]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl Sep 22 10:55:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.504s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:55:55 devstack cinder-volume[83310]: INFO cinder.volume.drivers.quobyte [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Mounting volume: 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c succeeded Sep 22 10:55:55 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 10:55:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.556s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 10:55:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:55:55 devstack quobyte-client[83313]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 22 10:55:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.066s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:55:55 devstack cinder-volume[83310]: INFO cinder.volume.driver [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Driver hasn't implemented _init_vendor_properties() Sep 22 10:55:55 devstack cinder-volume[83310]: DEBUG cinder.volume.driver [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144821166992, 'free_capacity_gb': 924.9144821166992, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83310) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 22 10:55:55 devstack cinder-volume[83310]: DEBUG oslo_db.sqlalchemy.engines [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83310) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writer thread running {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG cinder.db.sqlalchemy.api [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Building query based on filter {{(pid=83310) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3918}} Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83310) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 22 10:55:56 devstack cinder-volume[83310]: INFO cinder.keymgr.migration [None req-67654948-96bb-4945-85d4-ba38e4c08060 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.060s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 10:55:56 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Driver initialization completed successfully. Sep 22 10:55:56 devstack cinder-volume[83310]: INFO cinder.manager [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Initiating service 3 cleanup Sep 22 10:55:56 devstack cinder-volume[83310]: INFO cinder.manager [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Service 3 cleanup completed. Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG cinder.service [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Creating RPC server for service cinder-volume {{(pid=83310) start /opt/stack/cinder/cinder/service.py:239}} Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG cinder.service [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83310) start /opt/stack/cinder/cinder/service.py:245}} Sep 22 10:55:56 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13) Sep 22 10:55:56 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 10:55:56 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:55:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.101s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:55:57 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-7aa36d42-28ee-409d-913d-f02f5d66ffc4 None None] Driver post RPC initialization completed successfully. Sep 22 10:55:58 devstack quobyte-client[83313]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 22 10:56:04 devstack cinder-volume[83066]: DEBUG dbcounter [-] [83066] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83066) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:56:06 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:56:06 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:57:11 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 10:57:11 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 10:57:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Flow 'volume_create_manager' (e9a5845d-917d-40d4-a7a5-2e8290a07478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 10:57:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78edb030-f2ea-4213-8954-a743d04f8f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:57:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78edb030-f2ea-4213-8954-a743d04f8f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T08:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1811546663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=822ba931-2524-4610-b741-2cfcc25e47d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4165f3cd69f4df9b580980af5491768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T08:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T08:57:11Z,use_quota=True,user_id='b1b1a89908864e319fdd34e0275c4671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:57:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a33be31-f491-4b42-8d31-14adea2e2983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:57:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a33be31-f491-4b42-8d31-14adea2e2983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:57:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36145ae7-fc0d-4625-a17d-40d4e9cb3353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:57:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36145ae7-fc0d-4625-a17d-40d4e9cb3353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '822ba931-2524-4610-b741-2cfcc25e47d7', 'volume_name': 'volume-822ba931-2524-4610-b741-2cfcc25e47d7', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:57:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29512249-8ad1-454d-80a4-e0c4c89732cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:57:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29512249-8ad1-454d-80a4-e0c4c89732cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:57:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc8e9cb-65a6-4f1f-b365-6f51b0a13e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:57:12 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Volume 822ba931-2524-4610-b741-2cfcc25e47d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-822ba931-2524-4610-b741-2cfcc25e47d7', 'volume_size': 1} Sep 22 10:57:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 10:57:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 10:57:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T08:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1811546663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=822ba931-2524-4610-b741-2cfcc25e47d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4165f3cd69f4df9b580980af5491768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T08:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T08:57:11Z,use_quota=True,user_id='b1b1a89908864e319fdd34e0275c4671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 10:57:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Creating volume 822ba931-2524-4610-b741-2cfcc25e47d7 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 10:57:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 10:57:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 10:57:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 10:57:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 10:57:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 10:57:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 10:57:12 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 10:57:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-822ba931-2524-4610-b741-2cfcc25e47d7 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:57:12 devstack quobyte-client[83313]: System call of process 83600 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 10:57:12 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=2, name=volume-822ba931-2524-4610-b741-2cfcc25e47d7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 10:57:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-822ba931-2524-4610-b741-2cfcc25e47d7 1073741824" returned: 0 in 0.942s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:57:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-822ba931-2524-4610-b741-2cfcc25e47d7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:57:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-822ba931-2524-4610-b741-2cfcc25e47d7" returned: 0 in 0.117s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:57:13 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] <== create_volume: return (1208ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 10:57:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 10:57:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc8e9cb-65a6-4f1f-b365-6f51b0a13e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-822ba931-2524-4610-b741-2cfcc25e47d7', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:57:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2f0356-29d0-411c-aca4-0b5b33904b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:57:13 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Volume volume-822ba931-2524-4610-b741-2cfcc25e47d7 (822ba931-2524-4610-b741-2cfcc25e47d7): created successfully Sep 22 10:57:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2f0356-29d0-411c-aca4-0b5b33904b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:57:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Flow 'volume_create_manager' (e9a5845d-917d-40d4-a7a5-2e8290a07478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 10:57:13 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-7dd1adc8-12dd-4c05-ab8e-6bc5b10d6416 tempest-VolumesAssistedSnapshotsTest-661457791 None] Created volume successfully. Sep 22 10:57:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 10:57:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 10:57:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 10:57:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 10:57:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 10:57:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 10:57:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:57:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.117s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:57:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 10:57:23 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:57:23 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:58:07 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:58:07 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:58:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 10:58:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 10:58:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 10:58:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 10:58:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 10:58:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 10:58:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:58:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.387s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:58:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 10:58:20 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 10:58:20 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 10:58:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Flow 'volume_create_manager' (f7a95d57-6066-4a30-9d00-f043b4ab24b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 10:58:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d89faebc-be14-44fc-97eb-ec04a848ef87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:58:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d89faebc-be14-44fc-97eb-ec04a848ef87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T08:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2042838184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb4b54b-f3c6-4945-81fe-07f53571e240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='546a7b65327b42589cda82dc62500021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T08:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T08:58:20Z,use_quota=True,user_id='454b5605ecea4663bbc856f35a5dd0d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:58:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df536262-9f50-43fa-b29c-1e3f57c6edcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:58:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df536262-9f50-43fa-b29c-1e3f57c6edcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:58:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56eb6dce-0053-4660-bd32-fb990509cfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:58:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56eb6dce-0053-4660-bd32-fb990509cfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efb4b54b-f3c6-4945-81fe-07f53571e240', 'volume_name': 'volume-efb4b54b-f3c6-4945-81fe-07f53571e240', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:58:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff47026-3702-4cec-84c6-4296341a684d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:58:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff47026-3702-4cec-84c6-4296341a684d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:58:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5664f7ad-84cf-4aaf-b8d3-7bb85feee95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:58:22 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Volume efb4b54b-f3c6-4945-81fe-07f53571e240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efb4b54b-f3c6-4945-81fe-07f53571e240', 'volume_size': 1} Sep 22 10:58:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 10:58:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 10:58:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T08:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2042838184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb4b54b-f3c6-4945-81fe-07f53571e240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='546a7b65327b42589cda82dc62500021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T08:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T08:58:20Z,use_quota=True,user_id='454b5605ecea4663bbc856f35a5dd0d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 10:58:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Creating volume efb4b54b-f3c6-4945-81fe-07f53571e240 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 10:58:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 10:58:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 10:58:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 10:58:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 10:58:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 10:58:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 10:58:22 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 10:58:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-efb4b54b-f3c6-4945-81fe-07f53571e240 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:58:22 devstack quobyte-client[83313]: System call of process 84343 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 10:58:22 devstack quobyte-client[83313]: System call of process 84343 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 10:58:23 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=3, name=volume-efb4b54b-f3c6-4945-81fe-07f53571e240, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 10:58:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-efb4b54b-f3c6-4945-81fe-07f53571e240 1073741824" returned: 0 in 1.527s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:58:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-efb4b54b-f3c6-4945-81fe-07f53571e240 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:58:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-efb4b54b-f3c6-4945-81fe-07f53571e240" returned: 0 in 0.602s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:58:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] <== create_volume: return (2586ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 10:58:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.649s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 10:58:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5664f7ad-84cf-4aaf-b8d3-7bb85feee95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efb4b54b-f3c6-4945-81fe-07f53571e240', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:58:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2165dee-d985-4f8d-8019-9407c81ab19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:58:25 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Volume volume-efb4b54b-f3c6-4945-81fe-07f53571e240 (efb4b54b-f3c6-4945-81fe-07f53571e240): created successfully Sep 22 10:58:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2165dee-d985-4f8d-8019-9407c81ab19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:58:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Flow 'volume_create_manager' (f7a95d57-6066-4a30-9d00-f043b4ab24b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 10:58:25 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-ee85b4a5-1964-450f-ab57-ecbc656a2dab tempest-VolumesAdminNegativeTest-335873293 None] Created volume successfully. Sep 22 10:58:27 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Acquiring lock "cinder-efb4b54b-f3c6-4945-81fe-07f53571e240-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 10:58:27 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Lock "cinder-efb4b54b-f3c6-4945-81fe-07f53571e240-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 10:58:27 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 10:58:27 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Acquiring lock "cinder-quobyte-efb4b54b-f3c6-4945-81fe-07f53571e240" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 10:58:27 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Lock "cinder-quobyte-efb4b54b-f3c6-4945-81fe-07f53571e240" acquired by "delete_volume" :: waited 0.023s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 10:58:27 devstack cinder-volume[83310]: INFO oslo.privsep.daemon [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0xp6b_ds/privsep.sock'] Sep 22 10:58:27 devstack sudo[84374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0xp6b_ds/privsep.sock Sep 22 10:58:27 devstack sudo[84374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 10:58:36 devstack sudo[84374]: pam_unix(sudo:session): session closed for user root Sep 22 10:58:36 devstack cinder-volume[83310]: INFO oslo.privsep.daemon [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Spawned new privsep daemon via rootwrap Sep 22 10:58:36 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Accepted privsep connection to /tmp/tmp0xp6b_ds/privsep.sock {{(pid=83310) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}} Sep 22 10:58:36 devstack cinder-volume[83310]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 22 10:58:36 devstack cinder-volume[83310]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 22 10:58:36 devstack cinder-volume[83310]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 22 10:58:36 devstack cinder-volume[83310]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84420 Sep 22 10:58:36 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[648941a9-b8f1-4c9b-b2a6-cdfd8c0588cb]: (2,) {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 10:58:36 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd594f37-e64e-48e1-962d-a5b96ad17778]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 10:58:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-efb4b54b-f3c6-4945-81fe-07f53571e240 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:58:37 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:58:37 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:58:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-efb4b54b-f3c6-4945-81fe-07f53571e240" returned: 0 in 0.813s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:58:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-efb4b54b-f3c6-4945-81fe-07f53571e240 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:58:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-efb4b54b-f3c6-4945-81fe-07f53571e240" returned: 0 in 0.218s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:58:38 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Lock "cinder-quobyte-efb4b54b-f3c6-4945-81fe-07f53571e240" released by "delete_volume" :: held 10.589s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 10:58:38 devstack cinder-volume[83310]: WARNING cinder.quota [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 22 10:58:38 devstack cinder-volume[83310]: WARNING cinder.quota [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 22 10:58:38 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Created reservations ['fe617ba5-411f-49b1-ae9a-5ccf330472fd', '2b9bebe6-e80a-4730-8e74-215e6c714aac', '20470f0a-1f00-44ec-9c06-82c555bbe1c5', 'f9bf7e56-ad95-4886-ab5d-eff27051faf3'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 10:58:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 10:58:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 10:58:38 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 10:58:38 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 10:58:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 10:58:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:58:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.114s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:58:38 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 10:58:38 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Deleted volume successfully. Sep 22 10:58:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c86e57cb-6205-47b5-ba3e-163c025c21df tempest-VolumesAdminNegativeTest-335873293 None] Lock "cinder-efb4b54b-f3c6-4945-81fe-07f53571e240-delete_volume" released by "delete_volume" :: held 12.155s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 10:58:48 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=2,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:58:49 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:59:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 10:59:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 10:59:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 10:59:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 10:59:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 10:59:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 10:59:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:59:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.183s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:59:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 10:59:23 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Flow 'volume_create_manager' (ced178ce-864a-4ba2-841b-623334e4cbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc62dc3-2e72-4188-9646-5b4b553377d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc62dc3-2e72-4188-9646-5b4b553377d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T08:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-603299653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa001fa6-d557-4aa2-8699-8e19a9e2b3ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b3bdb7fe274c568d4a7e74f8059cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T08:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T08:59:23Z,use_quota=True,user_id='118b50a7a49743d98f48902000407bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16ca100-9984-4219-b255-5000f722470e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16ca100-9984-4219-b255-5000f722470e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3915fdeb-54c2-49b5-8119-7cc656e68504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3915fdeb-54c2-49b5-8119-7cc656e68504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa001fa6-d557-4aa2-8699-8e19a9e2b3ff', 'volume_name': 'volume-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dddce1b4-9f5c-49af-8e68-d3ccb6cbffb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dddce1b4-9f5c-49af-8e68-d3ccb6cbffb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753a9f71-197e-4f03-8b5e-32873f8adabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:59:23 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Volume fa001fa6-d557-4aa2-8699-8e19a9e2b3ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff', 'volume_size': 1} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T08:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-603299653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa001fa6-d557-4aa2-8699-8e19a9e2b3ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b3bdb7fe274c568d4a7e74f8059cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T08:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T08:59:23Z,use_quota=True,user_id='118b50a7a49743d98f48902000407bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Creating volume fa001fa6-d557-4aa2-8699-8e19a9e2b3ff {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 10:59:23 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 10:59:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:59:23 devstack quobyte-client[83313]: System call of process 84617 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 10:59:23 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=4, name=volume-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 10:59:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff 1073741824" returned: 0 in 0.559s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:59:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:59:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff" returned: 0 in 0.363s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:59:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] <== create_volume: return (1109ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 10:59:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 10:59:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753a9f71-197e-4f03-8b5e-32873f8adabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:59:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae654a25-7a16-4542-8236-45f6ab4be33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:59:25 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Volume volume-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff (fa001fa6-d557-4aa2-8699-8e19a9e2b3ff): created successfully Sep 22 10:59:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae654a25-7a16-4542-8236-45f6ab4be33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:59:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Flow 'volume_create_manager' (ced178ce-864a-4ba2-841b-623334e4cbfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 10:59:25 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-444c8376-f60d-400d-b60b-c4bada5c6d9d tempest-AttachSCSIVolumeTestJSON-305327833 None] Created volume successfully. Sep 22 10:59:35 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:59:35 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:59:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-05876d99-3ee6-4d61-80ca-33ea2a0fa9dd req-c306dca2-cd53-4363-af64-19304fb96aab tempest-AttachSCSIVolumeTestJSON-305327833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 10:59:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-05876d99-3ee6-4d61-80ca-33ea2a0fa9dd req-c306dca2-cd53-4363-af64-19304fb96aab tempest-AttachSCSIVolumeTestJSON-305327833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 10:59:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-29f9dfb7-b268-4baf-a260-c639fae0774f req-c4efd578-d506-45e5-b5fa-fcc7e5aedb41 tempest-VolumesAssistedSnapshotsTest-661457791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 10:59:37 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9111753-30a3-457c-b43f-fc5be99eed88]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 10:59:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-05876d99-3ee6-4d61-80ca-33ea2a0fa9dd req-c306dca2-cd53-4363-af64-19304fb96aab tempest-AttachSCSIVolumeTestJSON-305327833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:59:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-05876d99-3ee6-4d61-80ca-33ea2a0fa9dd req-c306dca2-cd53-4363-af64-19304fb96aab tempest-AttachSCSIVolumeTestJSON-305327833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff" returned: 0 in 0.458s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:59:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-05876d99-3ee6-4d61-80ca-33ea2a0fa9dd req-c306dca2-cd53-4363-af64-19304fb96aab tempest-AttachSCSIVolumeTestJSON-305327833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.507s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 10:59:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-29f9dfb7-b268-4baf-a260-c639fae0774f req-c4efd578-d506-45e5-b5fa-fcc7e5aedb41 tempest-VolumesAssistedSnapshotsTest-661457791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.813s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 10:59:38 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c48fe53-6e98-4383-8258-fbd69ed02133]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 10:59:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-29f9dfb7-b268-4baf-a260-c639fae0774f req-c4efd578-d506-45e5-b5fa-fcc7e5aedb41 tempest-VolumesAssistedSnapshotsTest-661457791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-822ba931-2524-4610-b741-2cfcc25e47d7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:59:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-05876d99-3ee6-4d61-80ca-33ea2a0fa9dd req-c306dca2-cd53-4363-af64-19304fb96aab tempest-AttachSCSIVolumeTestJSON-305327833 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5bebb60e-fa92-4b75-9e40-db591824bec8', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 10:59:39 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-05876d99-3ee6-4d61-80ca-33ea2a0fa9dd req-c306dca2-cd53-4363-af64-19304fb96aab tempest-AttachSCSIVolumeTestJSON-305327833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 10:59:39 devstack quobyte-client[83313]: System call of process 84657 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 10:59:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-29f9dfb7-b268-4baf-a260-c639fae0774f req-c4efd578-d506-45e5-b5fa-fcc7e5aedb41 tempest-VolumesAssistedSnapshotsTest-661457791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-822ba931-2524-4610-b741-2cfcc25e47d7" returned: 0 in 0.635s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:59:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-29f9dfb7-b268-4baf-a260-c639fae0774f req-c4efd578-d506-45e5-b5fa-fcc7e5aedb41 tempest-VolumesAssistedSnapshotsTest-661457791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.709s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 10:59:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-29f9dfb7-b268-4baf-a260-c639fae0774f req-c4efd578-d506-45e5-b5fa-fcc7e5aedb41 tempest-VolumesAssistedSnapshotsTest-661457791 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-822ba931-2524-4610-b741-2cfcc25e47d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b8b4df3-121e-4b53-8d5b-db75e9560fa1', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 10:59:39 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-29f9dfb7-b268-4baf-a260-c639fae0774f req-c4efd578-d506-45e5-b5fa-fcc7e5aedb41 tempest-VolumesAssistedSnapshotsTest-661457791 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 10:59:39 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-05876d99-3ee6-4d61-80ca-33ea2a0fa9dd req-c306dca2-cd53-4363-af64-19304fb96aab tempest-AttachSCSIVolumeTestJSON-305327833 None] attachment_update completed successfully. Sep 22 10:59:39 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-29f9dfb7-b268-4baf-a260-c639fae0774f req-c4efd578-d506-45e5-b5fa-fcc7e5aedb41 tempest-VolumesAssistedSnapshotsTest-661457791 None] attachment_update completed successfully. Sep 22 10:59:49 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:59:49 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=12,cinder:UPDATE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 10:59:58 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Flow 'volume_create_manager' (40648450-853f-49ba-a01a-a18b6ede8b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95be0898-85ef-4d3b-b520-2a069ae100ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95be0898-85ef-4d3b-b520-2a069ae100ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T08:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1794172014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c433c7de3444fda427685955718754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T08:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T08:59:58Z,use_quota=True,user_id='1a598cfaca134775aa52891276f24e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34abbc4-90cf-4334-97f4-81ad275aadb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d34abbc4-90cf-4334-97f4-81ad275aadb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a044ac-1569-4e69-a5d0-80ff5d25607b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a044ac-1569-4e69-a5d0-80ff5d25607b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f', 'volume_name': 'volume-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d6301b-8262-454a-942d-cbad3f540afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45d6301b-8262-454a-942d-cbad3f540afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cef870f-5fa4-4393-99dd-2166ab38f314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:59:58 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Volume e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f', 'volume_size': 1} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T08:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1794172014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c433c7de3444fda427685955718754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T08:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T08:59:58Z,use_quota=True,user_id='1a598cfaca134775aa52891276f24e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Creating volume e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 10:59:58 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:59:58 devstack quobyte-client[83313]: System call of process 85208 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 10:59:58 devstack quobyte-client[83313]: System call of process 85208 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 10:59:58 devstack quobyte-client[83313]: System call of process 85208 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 10:59:58 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=5, name=volume-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f 1073741824" returned: 0 in 0.367s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:59:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 10:59:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f" returned: 0 in 0.080s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 10:59:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] <== create_volume: return (516ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 10:59:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.527s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 10:59:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cef870f-5fa4-4393-99dd-2166ab38f314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:59:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe52c8e5-1a3f-4399-9908-45c2a23b2353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 10:59:59 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Volume volume-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f (e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f): created successfully Sep 22 10:59:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe52c8e5-1a3f-4399-9908-45c2a23b2353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 10:59:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Flow 'volume_create_manager' (40648450-853f-49ba-a01a-a18b6ede8b93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 10:59:59 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-0ae49cba-90df-4dc2-885f-16c6eff359c6 tempest-DeleteServersTestJSON-1472634704 None] Created volume successfully. Sep 22 11:00:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-be56a606-b926-4ffa-9857-a415fb712f93 req-d511888a-7290-4b15-b705-f6c88240fc73 tempest-DeleteServersTestJSON-1472634704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:00:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-be56a606-b926-4ffa-9857-a415fb712f93 req-d511888a-7290-4b15-b705-f6c88240fc73 tempest-DeleteServersTestJSON-1472634704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:00:03 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[5376513a-bee6-49bd-8afc-0671649d082f]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:00:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-be56a606-b926-4ffa-9857-a415fb712f93 req-d511888a-7290-4b15-b705-f6c88240fc73 tempest-DeleteServersTestJSON-1472634704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:00:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-be56a606-b926-4ffa-9857-a415fb712f93 req-d511888a-7290-4b15-b705-f6c88240fc73 tempest-DeleteServersTestJSON-1472634704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f" returned: 0 in 0.413s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:00:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-be56a606-b926-4ffa-9857-a415fb712f93 req-d511888a-7290-4b15-b705-f6c88240fc73 tempest-DeleteServersTestJSON-1472634704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.472s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:00:03 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-be56a606-b926-4ffa-9857-a415fb712f93 req-d511888a-7290-4b15-b705-f6c88240fc73 tempest-DeleteServersTestJSON-1472634704 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08cc6a28-4159-4a2a-8296-5883629afd11', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:00:03 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-be56a606-b926-4ffa-9857-a415fb712f93 req-d511888a-7290-4b15-b705-f6c88240fc73 tempest-DeleteServersTestJSON-1472634704 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:00:03 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-be56a606-b926-4ffa-9857-a415fb712f93 req-d511888a-7290-4b15-b705-f6c88240fc73 tempest-DeleteServersTestJSON-1472634704 None] attachment_update completed successfully. Sep 22 11:00:13 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-95f65fc5-b88d-4bc5-aa84-5400f12a263d req-5c80a899-ac54-4b79-8c1e-283eee2ccdcd tempest-VolumesAssistedSnapshotsTest-661457791 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:00:13 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-95f65fc5-b88d-4bc5-aa84-5400f12a263d req-5c80a899-ac54-4b79-8c1e-283eee2ccdcd tempest-VolumesAssistedSnapshotsTest-661457791 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:00:13 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-95f65fc5-b88d-4bc5-aa84-5400f12a263d req-5c80a899-ac54-4b79-8c1e-283eee2ccdcd tempest-VolumesAssistedSnapshotsTest-661457791 None] Terminate volume connection completed successfully. Sep 22 11:00:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-95f65fc5-b88d-4bc5-aa84-5400f12a263d req-5c80a899-ac54-4b79-8c1e-283eee2ccdcd tempest-VolumesAssistedSnapshotsTest-661457791 None] Deleting attachment 8b8b4df3-121e-4b53-8d5b-db75e9560fa1. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:00:13 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-476433ae-cd8a-417e-9140-5e6f621a0927 req-0a19fb86-d2f1-48f0-9d8b-8d5c1cc35f18 tempest-AttachSCSIVolumeTestJSON-305327833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:00:13 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-476433ae-cd8a-417e-9140-5e6f621a0927 req-0a19fb86-d2f1-48f0-9d8b-8d5c1cc35f18 tempest-AttachSCSIVolumeTestJSON-305327833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:00:13 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-476433ae-cd8a-417e-9140-5e6f621a0927 req-0a19fb86-d2f1-48f0-9d8b-8d5c1cc35f18 tempest-AttachSCSIVolumeTestJSON-305327833 None] Terminate volume connection completed successfully. Sep 22 11:00:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-476433ae-cd8a-417e-9140-5e6f621a0927 req-0a19fb86-d2f1-48f0-9d8b-8d5c1cc35f18 tempest-AttachSCSIVolumeTestJSON-305327833 None] Deleting attachment 5bebb60e-fa92-4b75-9e40-db591824bec8. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:00:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] Acquiring lock "cinder-822ba931-2524-4610-b741-2cfcc25e47d7-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:00:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] Lock "cinder-822ba931-2524-4610-b741-2cfcc25e47d7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:00:15 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:00:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] Acquiring lock "cinder-quobyte-822ba931-2524-4610-b741-2cfcc25e47d7" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:00:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] Lock "cinder-quobyte-822ba931-2524-4610-b741-2cfcc25e47d7" acquired by "delete_volume" :: waited 0.028s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:00:15 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4ce735-f9d6-44dd-8fa3-9493342dcf38]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:00:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-822ba931-2524-4610-b741-2cfcc25e47d7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:00:16 devstack quobyte-client[83313]: System call of process 85317 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:00:16 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-68bfa621-bbdf-456b-ab67-01f545ce19a7 req-63d8ed70-2c5b-4862-8350-29e1056ef8e4 tempest-DeleteServersTestJSON-1472634704 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:00:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-822ba931-2524-4610-b741-2cfcc25e47d7" returned: 0 in 0.685s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:00:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-822ba931-2524-4610-b741-2cfcc25e47d7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:00:16 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-68bfa621-bbdf-456b-ab67-01f545ce19a7 req-63d8ed70-2c5b-4862-8350-29e1056ef8e4 tempest-DeleteServersTestJSON-1472634704 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:00:16 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-68bfa621-bbdf-456b-ab67-01f545ce19a7 req-63d8ed70-2c5b-4862-8350-29e1056ef8e4 tempest-DeleteServersTestJSON-1472634704 None] Terminate volume connection completed successfully. Sep 22 11:00:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-68bfa621-bbdf-456b-ab67-01f545ce19a7 req-63d8ed70-2c5b-4862-8350-29e1056ef8e4 tempest-DeleteServersTestJSON-1472634704 None] Deleting attachment 08cc6a28-4159-4a2a-8296-5883629afd11. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:00:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-822ba931-2524-4610-b741-2cfcc25e47d7" returned: 0 in 0.193s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:00:16 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] Lock "cinder-quobyte-822ba931-2524-4610-b741-2cfcc25e47d7" released by "delete_volume" :: held 1.003s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:00:16 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] Created reservations ['f1e59271-1e38-487a-b4bc-fa33aa4774b8', '335e1c46-5422-4eef-9a9a-7193ded17509', '21f7c0f3-f350-4f91-ae6d-e8fcaf7ee7b6', 'fa6207f7-ffd9-4e64-afbe-ba0dba1d6928'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:00:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:00:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:00:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:00:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:00:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:00:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:00:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:00:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:00:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:00:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:00:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:00:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:00:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:00:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.410s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:00:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:00:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.454s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:00:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:00:17 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] Deleted volume successfully. Sep 22 11:00:18 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c4db5f58-3ddc-41c4-b69d-cee109b177bf tempest-VolumesAssistedSnapshotsTest-661457791 None] Lock "cinder-822ba931-2524-4610-b741-2cfcc25e47d7-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:00:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] Acquiring lock "cinder-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:00:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] Lock "cinder-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:00:22 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:00:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] Acquiring lock "cinder-quobyte-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:00:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] Lock "cinder-quobyte-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f" acquired by "delete_volume" :: waited 0.023s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:00:22 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee70cb6-2f3d-4044-9803-f97b63748be3]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:00:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:00:23 devstack quobyte-client[83313]: System call of process 85418 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:00:23 devstack quobyte-client[83313]: System call of process 85418 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:00:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f" returned: 0 in 0.867s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:00:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:00:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f" returned: 0 in 0.177s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:00:24 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] Lock "cinder-quobyte-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f" released by "delete_volume" :: held 1.479s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:00:24 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] Created reservations ['7739eb31-d6e4-4a07-ba24-d78b8e11d504', '54c57f15-fd00-4d9b-a606-f707287cfb85', '3f755550-a674-4246-8be3-83dc92ae511f', '9c876188-0e93-430d-9422-f296d1308023'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:00:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:00:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:00:25 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:00:25 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:00:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:00:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:00:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.130s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:00:25 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:00:25 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] Deleted volume successfully. Sep 22 11:00:25 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ccc0b796-6d17-4994-8ffc-162a5b0ecd15 tempest-DeleteServersTestJSON-1472634704 None] Lock "cinder-e9f4d850-3d29-42ff-bf46-ec1bd2c3d80f-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:00:35 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=25,cinder:SELECT=17,cinder:DELETE=1,cinder:INSERT=3 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:00:35 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=23,cinder:UPDATE=15,cinder:INSERT=5,cinder:DELETE=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:00:35 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] Acquiring lock "cinder-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:00:35 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] Lock "cinder-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:00:35 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:00:35 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] Acquiring lock "cinder-quobyte-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:00:35 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] Lock "cinder-quobyte-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff" acquired by "delete_volume" :: waited 0.015s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:00:35 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8171add5-9d3a-4277-82bd-43bf7d10ef74]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:00:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:00:36 devstack quobyte-client[83313]: System call of process 85454 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:00:36 devstack quobyte-client[83313]: System call of process 85454 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:00:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff" returned: 0 in 0.673s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:00:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:00:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff" returned: 0 in 0.159s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:00:36 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] Lock "cinder-quobyte-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff" released by "delete_volume" :: held 1.022s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:00:37 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] Created reservations ['4486d560-8530-4617-bc8c-6b748c8628ef', '3f37efe8-73cc-44d8-8ccb-5099915aebc5', '31406ce9-2e87-4f1e-b07e-15c2618e2f02', '423db0c0-28f9-42c9-afe8-a83f15fbe896'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:00:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:00:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:00:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:00:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:00:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:00:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:00:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.093s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:00:37 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:00:37 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] Deleted volume successfully. Sep 22 11:00:37 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4230d26b-d029-44c6-ae42-eebabe839e88 tempest-AttachSCSIVolumeTestJSON-305327833 None] Lock "cinder-fa001fa6-d557-4aa2-8699-8e19a9e2b3ff-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:00:47 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=8 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:00:47 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:01:09 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:01:09 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:01:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Flow 'volume_create_manager' (39730997-f464-4961-94c4-f6bb4063aa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:01:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305339af-19c2-49a9-bf65-585b2022c05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305339af-19c2-49a9-bf65-585b2022c05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1362065735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4891397a-84f2-493e-8537-68f79b9dba6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8354778311146e89710e22559d7533c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:01:09Z,use_quota=True,user_id='8e3d2ad81c9f4cb6953ffd9e6540c8ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7e5931-8eda-4bbb-a9fe-bb37d74a9cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7e5931-8eda-4bbb-a9fe-bb37d74a9cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28f3aa0-246d-46c6-85a0-de4cb4d70962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:09 devstack cinder-volume[83310]: DEBUG cinder.image.glance [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Creating Keystone auth plugin from conf {{(pid=83310) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 22 11:01:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28f3aa0-246d-46c6-85a0-de4cb4d70962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4891397a-84f2-493e-8537-68f79b9dba6a', 'volume_name': 'volume-4891397a-84f2-493e-8537-68f79b9dba6a', 'volume_size': 1, 'image_id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a739f36f4ea4c5eb46d43587eb0544d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'created_at': datetime.datetime(2025, 9, 22, 8, 49, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 8, 49, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a1d9109-49e8-406b-a105-f8fc540ab994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5aa428-51c8-4775-9c41-a1dc516ff68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5aa428-51c8-4775-9c41-a1dc516ff68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc3785f9-1f47-4b44-8119-9a2b8d9ec83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:10 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Volume 4891397a-84f2-493e-8537-68f79b9dba6a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4891397a-84f2-493e-8537-68f79b9dba6a', 'volume_size': 1, 'image_id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a739f36f4ea4c5eb46d43587eb0544d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'created_at': datetime.datetime(2025, 9, 22, 8, 49, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 8, 49, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a1d9109-49e8-406b-a105-f8fc540ab994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 22 11:01:10 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Cloning 4891397a-84f2-493e-8537-68f79b9dba6a from image 1a1d9109-49e8-406b-a105-f8fc540ab994 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}]). {{(pid=83310) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 22 11:01:11 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_lpk_tnxudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 22 11:01:11 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Image download 20.69 MB at 20.69 MB/s Sep 22 11:01:11 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e53098-2c96-4bce-b4e4-c80aa6ec14f2]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:01:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_lpk_tnxudevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:01:12 devstack sudo[85533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_lpk_tnxudevstack@QuobyteHD Sep 22 11:01:12 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 11:01:13 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root Sep 22 11:01:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_lpk_tnxudevstack@QuobyteHD" returned: 0 in 2.424s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:01:14 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Temporary image 1a1d9109-49e8-406b-a105-f8fc540ab994 is fetched for user 8e3d2ad81c9f4cb6953ffd9e6540c8ee. {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 22 11:01:14 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5f89ab-c986-40a4-891e-8eb0dcc96a2e]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:01:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_lpk_tnxudevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:01:15 devstack sudo[85539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_lpk_tnxudevstack@QuobyteHD Sep 22 11:01:15 devstack sudo[85539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.073s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.186s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:01:17 devstack sudo[85539]: pam_unix(sudo:session): session closed for user root Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_lpk_tnxudevstack@QuobyteHD" returned: 0 in 3.226s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1362065735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4891397a-84f2-493e-8537-68f79b9dba6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8354778311146e89710e22559d7533c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:01:09Z,use_quota=True,user_id='8e3d2ad81c9f4cb6953ffd9e6540c8ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Creating volume 4891397a-84f2-493e-8537-68f79b9dba6a {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:01:17 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:01:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:01:18 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=6, name=volume-4891397a-84f2-493e-8537-68f79b9dba6a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:01:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a 1073741824" returned: 0 in 0.505s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:01:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:01:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a" returned: 0 in 0.121s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:01:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] <== create_volume: return (728ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:01:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:01:18 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Attempting download of 1a1d9109-49e8-406b-a105-f8fc540ab994 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}])) to volume 4891397a-84f2-493e-8537-68f79b9dba6a. {{(pid=83310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 22 11:01:19 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd5314d-bf87-4e37-84d2-1db85e6d8f6f]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:01:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_0yuiwokf {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:01:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_0yuiwokf" returned: 0 in 0.568s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:01:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_0yuiwokf {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:01:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_0yuiwokf" returned: 1 in 0.562s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:01:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_0yuiwokf' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:01:20 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5e1916-4fc6-4506-a440-787391408b97]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:01:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_lpk_tnxudevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:01:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_lpk_tnxudevstack@QuobyteHD" returned: 0 in 0.535s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:01:20 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] 1a1d9109-49e8-406b-a105-f8fc540ab994 was qcow2, converting to raw {{(pid=83310) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 22 11:01:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_lpk_tnxudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:01:21 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=6, name=volume-4891397a-84f2-493e-8537-68f79b9dba6a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:01:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_lpk_tnxudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a" returned: 0 in 1.398s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:01:22 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_lpk_tnxudevstack@QuobyteHD, size 112.00 MB, duration 1.44 sec, destination /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a {{(pid=83310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 22 11:01:22 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Converted 112.00 MB image at 77.73 MB/s Sep 22 11:01:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:01:22 devstack quobyte-client[83313]: System call of process 85566 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:01:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a 1G" returned: 0 in 0.161s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:01:22 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba2eaa0-5a91-4a3a-86f0-01902cc9d7ac]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:01:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:01:23 devstack quobyte-client[83313]: System call of process 85569 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:01:23 devstack quobyte-client[83313]: System call of process 85569 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:01:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a" returned: 0 in 0.521s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:01:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:01:23 devstack quobyte-client[83313]: System call of process 85571 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:01:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a" returned: 1 in 0.503s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:01:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:01:23 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Downloaded image 1a1d9109-49e8-406b-a105-f8fc540ab994 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}])) to volume 4891397a-84f2-493e-8537-68f79b9dba6a successfully. {{(pid=83310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 22 11:01:23 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Temporary image 1a1d9109-49e8-406b-a105-f8fc540ab994 for user 8e3d2ad81c9f4cb6953ffd9e6540c8ee is deleted. {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 22 11:01:23 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Marking volume 4891397a-84f2-493e-8537-68f79b9dba6a as bootable. {{(pid=83310) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 22 11:01:24 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Copying metadata from image 1a1d9109-49e8-406b-a105-f8fc540ab994 to 4891397a-84f2-493e-8537-68f79b9dba6a. {{(pid=83310) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 11:01:24 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Creating volume glance metadata for volume 4891397a-84f2-493e-8537-68f79b9dba6a backed by image 1a1d9109-49e8-406b-a105-f8fc540ab994 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83310) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 11:01:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc3785f9-1f47-4b44-8119-9a2b8d9ec83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4891397a-84f2-493e-8537-68f79b9dba6a', 'volume_size': 1, 'image_id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a739f36f4ea4c5eb46d43587eb0544d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'created_at': datetime.datetime(2025, 9, 22, 8, 49, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 8, 49, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a1d9109-49e8-406b-a105-f8fc540ab994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1297855-8114-4396-b931-658bafaa3d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:24 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Volume volume-4891397a-84f2-493e-8537-68f79b9dba6a (4891397a-84f2-493e-8537-68f79b9dba6a): created successfully Sep 22 11:01:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1297855-8114-4396-b931-658bafaa3d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Flow 'volume_create_manager' (39730997-f464-4961-94c4-f6bb4063aa06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:01:24 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-3ecc91a6-82a9-439d-b12f-fac8b4b461ef tempest-TaggedBootDevicesTest-1069441050 None] Created volume successfully. Sep 22 11:01:25 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Flow 'volume_create_manager' (86bcfc54-a18c-480b-9fc0-52055b6b7820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859e062d-9038-4cb4-87ac-053bf9f308c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859e062d-9038-4cb4-87ac-053bf9f308c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2124470497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13500a63-b091-43d6-8a16-808858908ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8354778311146e89710e22559d7533c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:01:25Z,use_quota=True,user_id='8e3d2ad81c9f4cb6953ffd9e6540c8ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80af3fd7-232d-4d9d-bf85-356c8fe0c4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80af3fd7-232d-4d9d-bf85-356c8fe0c4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99adb375-a773-4953-9ac0-e97418dcfadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99adb375-a773-4953-9ac0-e97418dcfadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13500a63-b091-43d6-8a16-808858908ced', 'volume_name': 'volume-13500a63-b091-43d6-8a16-808858908ced', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0282ce51-4361-4460-9138-cacf1219480f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0282ce51-4361-4460-9138-cacf1219480f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71cbce6-d751-4f54-a855-40f10022c58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:25 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Volume 13500a63-b091-43d6-8a16-808858908ced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13500a63-b091-43d6-8a16-808858908ced', 'volume_size': 1} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2124470497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13500a63-b091-43d6-8a16-808858908ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8354778311146e89710e22559d7533c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:01:25Z,use_quota=True,user_id='8e3d2ad81c9f4cb6953ffd9e6540c8ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Creating volume 13500a63-b091-43d6-8a16-808858908ced {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:01:25 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:01:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-13500a63-b091-43d6-8a16-808858908ced 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:01:25 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=7, name=volume-13500a63-b091-43d6-8a16-808858908ced, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:01:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-13500a63-b091-43d6-8a16-808858908ced 1073741824" returned: 0 in 0.470s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:01:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-13500a63-b091-43d6-8a16-808858908ced {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:01:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-13500a63-b091-43d6-8a16-808858908ced" returned: 0 in 0.205s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:01:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] <== create_volume: return (862ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:01:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:01:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71cbce6-d751-4f54-a855-40f10022c58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13500a63-b091-43d6-8a16-808858908ced', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e07f20-6214-419c-b086-27db286510ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:27 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Volume volume-13500a63-b091-43d6-8a16-808858908ced (13500a63-b091-43d6-8a16-808858908ced): created successfully Sep 22 11:01:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e07f20-6214-419c-b086-27db286510ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Flow 'volume_create_manager' (86bcfc54-a18c-480b-9fc0-52055b6b7820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:01:27 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-5323049e-007c-4d1d-bdcd-b7f89c6fe2db tempest-TaggedBootDevicesTest-1069441050 None] Created volume successfully. Sep 22 11:01:28 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Flow 'volume_create_manager' (7c101f03-5ab5-44ea-9ec0-22cc13c316db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274e52e8-41d5-46d4-b555-29eee6fe16c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274e52e8-41d5-46d4-b555-29eee6fe16c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-141499626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d27e1eb7-5427-46e0-91b4-657dfac73ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8354778311146e89710e22559d7533c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:01:28Z,use_quota=True,user_id='8e3d2ad81c9f4cb6953ffd9e6540c8ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a36aba-c124-449c-b3fc-3c7572790596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a36aba-c124-449c-b3fc-3c7572790596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a624263-fffd-4cb7-b347-c4290887d05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a624263-fffd-4cb7-b347-c4290887d05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd27e1eb7-5427-46e0-91b4-657dfac73ee6', 'volume_name': 'volume-d27e1eb7-5427-46e0-91b4-657dfac73ee6', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00bf2b1-d27b-4e6f-a6d9-377b116a85de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00bf2b1-d27b-4e6f-a6d9-377b116a85de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8067e5-ebc5-432d-b01a-ae73e708af98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:28 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Volume d27e1eb7-5427-46e0-91b4-657dfac73ee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d27e1eb7-5427-46e0-91b4-657dfac73ee6', 'volume_size': 1} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-141499626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d27e1eb7-5427-46e0-91b4-657dfac73ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8354778311146e89710e22559d7533c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:01:28Z,use_quota=True,user_id='8e3d2ad81c9f4cb6953ffd9e6540c8ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Creating volume d27e1eb7-5427-46e0-91b4-657dfac73ee6 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:01:28 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:01:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d27e1eb7-5427-46e0-91b4-657dfac73ee6 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:01:28 devstack quobyte-client[83313]: System call of process 85581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:01:28 devstack quobyte-client[83313]: System call of process 85581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:01:28 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=8, name=volume-d27e1eb7-5427-46e0-91b4-657dfac73ee6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:01:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d27e1eb7-5427-46e0-91b4-657dfac73ee6 1073741824" returned: 0 in 0.478s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:01:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d27e1eb7-5427-46e0-91b4-657dfac73ee6 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:01:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d27e1eb7-5427-46e0-91b4-657dfac73ee6" returned: 0 in 0.220s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:01:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] <== create_volume: return (802ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:01:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:01:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8067e5-ebc5-432d-b01a-ae73e708af98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d27e1eb7-5427-46e0-91b4-657dfac73ee6', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0dfa235-3967-4487-994e-ffedcaa70a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:29 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Volume volume-d27e1eb7-5427-46e0-91b4-657dfac73ee6 (d27e1eb7-5427-46e0-91b4-657dfac73ee6): created successfully Sep 22 11:01:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0dfa235-3967-4487-994e-ffedcaa70a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Flow 'volume_create_manager' (7c101f03-5ab5-44ea-9ec0-22cc13c316db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:01:30 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-cf255cc6-834f-411c-b650-f07f44bbfc7a tempest-TaggedBootDevicesTest-1069441050 None] Created volume successfully. Sep 22 11:01:40 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=9,cinder:SELECT=15,cinder:INSERT=12,cinder:DELETE=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:01:40 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:01:40 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:01:40 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:01:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Flow 'volume_create_manager' (f85e7d99-3f1d-4d5e-90ad-78b803748f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:01:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b384d4-ea12-42f0-acbd-fd5a449e8289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b384d4-ea12-42f0-acbd-fd5a449e8289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1007074998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef39c08-e57c-4752-8599-3208b5800151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63314cf164024c95aceec8576151021b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:01:41Z,use_quota=True,user_id='1658c880dd154695afc7b513c0c8ca76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c75bbef-a7ad-4e68-b35f-4f386a27d532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c75bbef-a7ad-4e68-b35f-4f386a27d532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25169af0-ad2d-4c37-a47c-5ed61b0a3169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25169af0-ad2d-4c37-a47c-5ed61b0a3169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ef39c08-e57c-4752-8599-3208b5800151', 'volume_name': 'volume-6ef39c08-e57c-4752-8599-3208b5800151', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fadfdc24-e166-4884-aa68-82dc0dabaa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fadfdc24-e166-4884-aa68-82dc0dabaa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a3e19a-df60-4a88-acbe-f3850169720f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:41 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Volume 6ef39c08-e57c-4752-8599-3208b5800151: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ef39c08-e57c-4752-8599-3208b5800151', 'volume_size': 1} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1007074998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef39c08-e57c-4752-8599-3208b5800151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63314cf164024c95aceec8576151021b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:01:41Z,use_quota=True,user_id='1658c880dd154695afc7b513c0c8ca76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Creating volume 6ef39c08-e57c-4752-8599-3208b5800151 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:01:41 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6ef39c08-e57c-4752-8599-3208b5800151 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:01:41 devstack quobyte-client[83313]: System call of process 85587 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:01:41 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=9, name=volume-6ef39c08-e57c-4752-8599-3208b5800151, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6ef39c08-e57c-4752-8599-3208b5800151 1073741824" returned: 0 in 0.374s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6ef39c08-e57c-4752-8599-3208b5800151 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6ef39c08-e57c-4752-8599-3208b5800151" returned: 0 in 0.114s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] <== create_volume: return (555ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.568s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a3e19a-df60-4a88-acbe-f3850169720f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef39c08-e57c-4752-8599-3208b5800151', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1ed483-c14d-4584-8777-873a17c5c40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:01:41 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Volume volume-6ef39c08-e57c-4752-8599-3208b5800151 (6ef39c08-e57c-4752-8599-3208b5800151): created successfully Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1ed483-c14d-4584-8777-873a17c5c40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:01:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Flow 'volume_create_manager' (f85e7d99-3f1d-4d5e-90ad-78b803748f8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:01:41 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-fcdb9dd3-9cc3-4e52-b0a6-4271cef52288 tempest-TaggedAttachmentsTest-659792418 None] Created volume successfully. Sep 22 11:01:51 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=4 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:01:51 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=2,cinder:DELETE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:02:07 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:02:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-909abddc-468a-45ef-be7c-13b10b795caf req-245c72c5-07df-4c3a-b35c-0a09e9e07f36 tempest-TaggedBootDevicesTest-1069441050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:02:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-909abddc-468a-45ef-be7c-13b10b795caf req-245c72c5-07df-4c3a-b35c-0a09e9e07f36 tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:02:08 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1e5b40-9afd-4390-9e1f-9028ef076ab5]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:02:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-909abddc-468a-45ef-be7c-13b10b795caf req-245c72c5-07df-4c3a-b35c-0a09e9e07f36 tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:02:10 devstack quobyte-client[83313]: System call of process 85755 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:02:10 devstack quobyte-client[83313]: System call of process 85755 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:02:10 devstack quobyte-client[83313]: System call of process 85755 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:02:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-909abddc-468a-45ef-be7c-13b10b795caf req-245c72c5-07df-4c3a-b35c-0a09e9e07f36 tempest-TaggedBootDevicesTest-1069441050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a" returned: 0 in 1.832s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:02:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-909abddc-468a-45ef-be7c-13b10b795caf req-245c72c5-07df-4c3a-b35c-0a09e9e07f36 tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:02:13 devstack quobyte-client[83313]: System call of process 85763 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:02:13 devstack quobyte-client[83313]: System call of process 85763 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:02:13 devstack quobyte-client[83313]: System call of process 85763 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:02:13 devstack quobyte-client[83313]: System call of process 85763 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:02:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-909abddc-468a-45ef-be7c-13b10b795caf req-245c72c5-07df-4c3a-b35c-0a09e9e07f36 tempest-TaggedBootDevicesTest-1069441050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a" returned: 1 in 2.353s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:02:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-909abddc-468a-45ef-be7c-13b10b795caf req-245c72c5-07df-4c3a-b35c-0a09e9e07f36 tempest-TaggedBootDevicesTest-1069441050 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:02:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-909abddc-468a-45ef-be7c-13b10b795caf req-245c72c5-07df-4c3a-b35c-0a09e9e07f36 tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.733s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:02:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-909abddc-468a-45ef-be7c-13b10b795caf req-245c72c5-07df-4c3a-b35c-0a09e9e07f36 tempest-TaggedBootDevicesTest-1069441050 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-4891397a-84f2-493e-8537-68f79b9dba6a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f9d3d14-ff1e-43e6-81ff-faf5e9636ef2', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:02:15 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-909abddc-468a-45ef-be7c-13b10b795caf req-245c72c5-07df-4c3a-b35c-0a09e9e07f36 tempest-TaggedBootDevicesTest-1069441050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:02:16 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-909abddc-468a-45ef-be7c-13b10b795caf req-245c72c5-07df-4c3a-b35c-0a09e9e07f36 tempest-TaggedBootDevicesTest-1069441050 None] attachment_update completed successfully. Sep 22 11:02:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:02:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:02:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:02:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:02:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:02:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.100s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:02:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:02:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.775s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:02:18 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:02:26 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:02:26 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=5 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:02:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-909abddc-468a-45ef-be7c-13b10b795caf req-77804cf6-cfa3-4f47-92b1-f9491797be47 tempest-TaggedBootDevicesTest-1069441050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:02:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-909abddc-468a-45ef-be7c-13b10b795caf req-77804cf6-cfa3-4f47-92b1-f9491797be47 tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:02:29 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb347f3-74e8-4364-94fc-e38f91e84968]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:02:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-909abddc-468a-45ef-be7c-13b10b795caf req-77804cf6-cfa3-4f47-92b1-f9491797be47 tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-13500a63-b091-43d6-8a16-808858908ced {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:02:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-909abddc-468a-45ef-be7c-13b10b795caf req-77804cf6-cfa3-4f47-92b1-f9491797be47 tempest-TaggedBootDevicesTest-1069441050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-13500a63-b091-43d6-8a16-808858908ced" returned: 0 in 0.715s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:02:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-909abddc-468a-45ef-be7c-13b10b795caf req-77804cf6-cfa3-4f47-92b1-f9491797be47 tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.906s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:02:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-909abddc-468a-45ef-be7c-13b10b795caf req-77804cf6-cfa3-4f47-92b1-f9491797be47 tempest-TaggedBootDevicesTest-1069441050 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-13500a63-b091-43d6-8a16-808858908ced', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c74e145-969b-4051-ac28-acaee52f5173', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:02:30 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-909abddc-468a-45ef-be7c-13b10b795caf req-77804cf6-cfa3-4f47-92b1-f9491797be47 tempest-TaggedBootDevicesTest-1069441050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:02:31 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-909abddc-468a-45ef-be7c-13b10b795caf req-77804cf6-cfa3-4f47-92b1-f9491797be47 tempest-TaggedBootDevicesTest-1069441050 None] attachment_update completed successfully. Sep 22 11:02:41 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:02:41 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:02:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-909abddc-468a-45ef-be7c-13b10b795caf req-82b8e6ad-5726-404a-a958-e3f12ec70f32 tempest-TaggedBootDevicesTest-1069441050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:02:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-909abddc-468a-45ef-be7c-13b10b795caf req-82b8e6ad-5726-404a-a958-e3f12ec70f32 tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:02:43 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a262842-d8d1-4d64-948b-0373d05ef0ee]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:02:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-909abddc-468a-45ef-be7c-13b10b795caf req-82b8e6ad-5726-404a-a958-e3f12ec70f32 tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d27e1eb7-5427-46e0-91b4-657dfac73ee6 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:02:44 devstack quobyte-client[83313]: System call of process 85941 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:02:44 devstack quobyte-client[83313]: System call of process 85941 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:02:44 devstack quobyte-client[83313]: System call of process 85941 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:02:44 devstack quobyte-client[83313]: System call of process 85941 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:02:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-909abddc-468a-45ef-be7c-13b10b795caf req-82b8e6ad-5726-404a-a958-e3f12ec70f32 tempest-TaggedBootDevicesTest-1069441050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d27e1eb7-5427-46e0-91b4-657dfac73ee6" returned: 0 in 1.719s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:02:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-909abddc-468a-45ef-be7c-13b10b795caf req-82b8e6ad-5726-404a-a958-e3f12ec70f32 tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.867s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:02:46 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-909abddc-468a-45ef-be7c-13b10b795caf req-82b8e6ad-5726-404a-a958-e3f12ec70f32 tempest-TaggedBootDevicesTest-1069441050 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-d27e1eb7-5427-46e0-91b4-657dfac73ee6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c136208-8b68-43cd-ba5a-a8cbdf7c5fca', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:02:46 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-909abddc-468a-45ef-be7c-13b10b795caf req-82b8e6ad-5726-404a-a958-e3f12ec70f32 tempest-TaggedBootDevicesTest-1069441050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:02:47 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-909abddc-468a-45ef-be7c-13b10b795caf req-82b8e6ad-5726-404a-a958-e3f12ec70f32 tempest-TaggedBootDevicesTest-1069441050 None] attachment_update completed successfully. Sep 22 11:02:57 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:02:57 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:03:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:03:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:03:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:03:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:03:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:03:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:03:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:03:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.425s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:03:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:03:30 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Flow 'volume_create_manager' (925e07ad-c58f-4125-8f8c-871fac309055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d7f16b-9e0e-44d5-a571-5144dec44987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0d7f16b-9e0e-44d5-a571-5144dec44987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1341967158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f9844b-dabe-45c3-a560-0e7bc4184178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f8c86aaac74a5e811df4208fc00a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:03:30Z,use_quota=True,user_id='60802f583151442c9872b25cd4273630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02cd9f1-5973-49aa-badd-4d8e401135dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02cd9f1-5973-49aa-badd-4d8e401135dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c333362c-2ac9-4fbc-a3a1-5555998b1c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c333362c-2ac9-4fbc-a3a1-5555998b1c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70f9844b-dabe-45c3-a560-0e7bc4184178', 'volume_name': 'volume-70f9844b-dabe-45c3-a560-0e7bc4184178', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0e8b44-da0b-428c-b7e8-3bca78846c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0e8b44-da0b-428c-b7e8-3bca78846c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce03669-63f6-4093-a81c-175dc925270b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:03:30 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Volume 70f9844b-dabe-45c3-a560-0e7bc4184178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70f9844b-dabe-45c3-a560-0e7bc4184178', 'volume_size': 1} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1341967158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f9844b-dabe-45c3-a560-0e7bc4184178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f8c86aaac74a5e811df4208fc00a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:03:30Z,use_quota=True,user_id='60802f583151442c9872b25cd4273630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Creating volume 70f9844b-dabe-45c3-a560-0e7bc4184178 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:03:30 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:03:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-70f9844b-dabe-45c3-a560-0e7bc4184178 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:03:30 devstack quobyte-client[83313]: System call of process 86680 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:03:30 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=10, name=volume-70f9844b-dabe-45c3-a560-0e7bc4184178, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:03:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-70f9844b-dabe-45c3-a560-0e7bc4184178 1073741824" returned: 0 in 1.226s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:03:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-70f9844b-dabe-45c3-a560-0e7bc4184178 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:03:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-70f9844b-dabe-45c3-a560-0e7bc4184178" returned: 0 in 0.510s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:03:32 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] <== create_volume: return (1923ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:03:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:03:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce03669-63f6-4093-a81c-175dc925270b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70f9844b-dabe-45c3-a560-0e7bc4184178', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:03:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa716ff-d3fc-4d4b-a954-4a340ed3938d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:03:33 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Volume volume-70f9844b-dabe-45c3-a560-0e7bc4184178 (70f9844b-dabe-45c3-a560-0e7bc4184178): created successfully Sep 22 11:03:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa716ff-d3fc-4d4b-a954-4a340ed3938d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:03:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Flow 'volume_create_manager' (925e07ad-c58f-4125-8f8c-871fac309055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:03:34 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-5726c988-4bb1-49a3-b6be-398ab73e88bc tempest-ServersNegativeTestJSON-1202391863 None] Created volume successfully. Sep 22 11:03:42 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:03:42 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Flow 'volume_create_manager' (fbacc57a-061c-46cc-a478-592e7437ec2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed330340-dff2-4dc7-919d-25825873d422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed330340-dff2-4dc7-919d-25825873d422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-299810503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5ffd3d-7f94-496a-8db3-a5089f387e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f8c86aaac74a5e811df4208fc00a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:03:42Z,use_quota=True,user_id='60802f583151442c9872b25cd4273630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9893af1b-621b-492d-be8b-fe320a41ab67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9893af1b-621b-492d-be8b-fe320a41ab67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f8fe78-311a-48b1-bc90-aff3402e7e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f8fe78-311a-48b1-bc90-aff3402e7e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e5ffd3d-7f94-496a-8db3-a5089f387e80', 'volume_name': 'volume-7e5ffd3d-7f94-496a-8db3-a5089f387e80', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd4284f-ef81-42f1-b1f1-755d03d7a66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd4284f-ef81-42f1-b1f1-755d03d7a66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75ab73f-b815-4a70-93ee-e88b75160228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:03:43 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Volume 7e5ffd3d-7f94-496a-8db3-a5089f387e80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e5ffd3d-7f94-496a-8db3-a5089f387e80', 'volume_size': 1} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-299810503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5ffd3d-7f94-496a-8db3-a5089f387e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f8c86aaac74a5e811df4208fc00a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:03:42Z,use_quota=True,user_id='60802f583151442c9872b25cd4273630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Creating volume 7e5ffd3d-7f94-496a-8db3-a5089f387e80 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:03:43 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:03:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-7e5ffd3d-7f94-496a-8db3-a5089f387e80 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:03:43 devstack quobyte-client[83313]: System call of process 86962 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:03:43 devstack quobyte-client[83313]: System call of process 86962 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:03:44 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=11, name=volume-7e5ffd3d-7f94-496a-8db3-a5089f387e80, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:03:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-7e5ffd3d-7f94-496a-8db3-a5089f387e80 1073741824" returned: 0 in 1.232s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:03:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-7e5ffd3d-7f94-496a-8db3-a5089f387e80 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:03:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-7e5ffd3d-7f94-496a-8db3-a5089f387e80" returned: 0 in 0.267s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:03:45 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] <== create_volume: return (1694ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:03:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:03:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75ab73f-b815-4a70-93ee-e88b75160228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e5ffd3d-7f94-496a-8db3-a5089f387e80', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:03:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632492d9-906c-4cc2-a98a-cc9819f7ea64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:03:45 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Volume volume-7e5ffd3d-7f94-496a-8db3-a5089f387e80 (7e5ffd3d-7f94-496a-8db3-a5089f387e80): created successfully Sep 22 11:03:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632492d9-906c-4cc2-a98a-cc9819f7ea64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:03:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Flow 'volume_create_manager' (fbacc57a-061c-46cc-a478-592e7437ec2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:03:45 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-710aa275-0212-4873-82ee-c5d9ede50fda tempest-ServersNegativeTestJSON-1202391863 None] Created volume successfully. Sep 22 11:03:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] Acquiring lock "cinder-7e5ffd3d-7f94-496a-8db3-a5089f387e80-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:03:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] Lock "cinder-7e5ffd3d-7f94-496a-8db3-a5089f387e80-delete_volume" acquired by "delete_volume" :: waited 0.212s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:03:49 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:03:49 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] Acquiring lock "cinder-quobyte-7e5ffd3d-7f94-496a-8db3-a5089f387e80" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:03:49 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] Lock "cinder-quobyte-7e5ffd3d-7f94-496a-8db3-a5089f387e80" acquired by "delete_volume" :: waited 0.046s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:03:49 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f69efe5-7926-4fe7-8984-bb1a493b48e2]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:03:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-7e5ffd3d-7f94-496a-8db3-a5089f387e80 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:03:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-7e5ffd3d-7f94-496a-8db3-a5089f387e80" returned: 0 in 1.710s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:03:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-7e5ffd3d-7f94-496a-8db3-a5089f387e80 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:03:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-7e5ffd3d-7f94-496a-8db3-a5089f387e80" returned: 0 in 0.540s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:03:52 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] Lock "cinder-quobyte-7e5ffd3d-7f94-496a-8db3-a5089f387e80" released by "delete_volume" :: held 2.876s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:03:53 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] Created reservations ['83155445-c1d6-4683-8b53-be1d41df21c8', '7e86ffe0-7b1b-4b22-8001-56ec2d7bfcf2', 'ccfb483c-2ea9-49b8-a5b0-c5ed41ea2cc5', '22bbcab2-bb06-4b9e-b15d-3625d9112281'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:03:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:03:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:03:53 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:03:53 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:03:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:03:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:03:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] Acquiring lock "cinder-70f9844b-dabe-45c3-a560-0e7bc4184178-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:03:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] Lock "cinder-70f9844b-dabe-45c3-a560-0e7bc4184178-delete_volume" acquired by "delete_volume" :: waited 0.375s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:03:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 1.502s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:03:55 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:03:55 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] Deleted volume successfully. Sep 22 11:03:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-20774be4-c061-4bdd-8c04-27fcf1f1c115 tempest-ServersNegativeTestJSON-1202391863 None] Lock "cinder-7e5ffd3d-7f94-496a-8db3-a5089f387e80-delete_volume" released by "delete_volume" :: held 7.035s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:03:56 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:03:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] Acquiring lock "cinder-quobyte-70f9844b-dabe-45c3-a560-0e7bc4184178" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:03:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] Lock "cinder-quobyte-70f9844b-dabe-45c3-a560-0e7bc4184178" acquired by "delete_volume" :: waited 0.017s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:03:56 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[051eb2e1-325e-4ad0-83f8-274fce9ccf23]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:03:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-70f9844b-dabe-45c3-a560-0e7bc4184178 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:03:57 devstack quobyte-client[83313]: System call of process 87031 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:03:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-70f9844b-dabe-45c3-a560-0e7bc4184178" returned: 0 in 1.595s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:03:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-70f9844b-dabe-45c3-a560-0e7bc4184178 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:03:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-70f9844b-dabe-45c3-a560-0e7bc4184178" returned: 0 in 0.566s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:03:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] Lock "cinder-quobyte-70f9844b-dabe-45c3-a560-0e7bc4184178" released by "delete_volume" :: held 2.468s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:03:59 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] Created reservations ['9e01f786-8a79-440e-a095-367fa564b31d', '4ef51e4f-4902-4e2a-b2e8-7d9020c2c58a', '2262860d-aad7-401f-a951-c9c65282b6c7', '7a6e2263-f248-4526-9663-997bb64ca43b'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:03:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:03:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:03:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:03:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:03:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:03:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:03:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.209s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:04:00 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:04:00 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] Deleted volume successfully. Sep 22 11:04:00 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cce5974b-ccfc-4ccb-af2f-eb0b07559de0 tempest-ServersNegativeTestJSON-1202391863 None] Lock "cinder-70f9844b-dabe-45c3-a560-0e7bc4184178-delete_volume" released by "delete_volume" :: held 5.494s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:04:09 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=14,cinder:UPDATE=26,cinder:INSERT=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:04:10 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=15,cinder:SELECT=11,cinder:DELETE=4,cinder:INSERT=6 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:04:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:04:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:04:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:04:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:04:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:04:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.062s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:04:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:04:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.261s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:04:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:04:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-3447ab2b-6d26-4b60-bacc-a920c6184dbb req-fe14a492-dfad-487a-97c7-24322e884b7f tempest-TaggedAttachmentsTest-659792418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:04:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-3447ab2b-6d26-4b60-bacc-a920c6184dbb req-fe14a492-dfad-487a-97c7-24322e884b7f tempest-TaggedAttachmentsTest-659792418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.018s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:04:19 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c646c1c-6cab-4b1c-97fd-baf986a948a2]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:04:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-3447ab2b-6d26-4b60-bacc-a920c6184dbb req-fe14a492-dfad-487a-97c7-24322e884b7f tempest-TaggedAttachmentsTest-659792418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6ef39c08-e57c-4752-8599-3208b5800151 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:04:20 devstack quobyte-client[83313]: System call of process 87223 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:04:20 devstack quobyte-client[83313]: System call of process 87223 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:04:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-3447ab2b-6d26-4b60-bacc-a920c6184dbb req-fe14a492-dfad-487a-97c7-24322e884b7f tempest-TaggedAttachmentsTest-659792418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6ef39c08-e57c-4752-8599-3208b5800151" returned: 0 in 1.154s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:04:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-3447ab2b-6d26-4b60-bacc-a920c6184dbb req-fe14a492-dfad-487a-97c7-24322e884b7f tempest-TaggedAttachmentsTest-659792418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.285s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:04:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-3447ab2b-6d26-4b60-bacc-a920c6184dbb req-fe14a492-dfad-487a-97c7-24322e884b7f tempest-TaggedAttachmentsTest-659792418 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-6ef39c08-e57c-4752-8599-3208b5800151', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b91885a-ee25-4be6-8f35-d49e69906637', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:04:20 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-3447ab2b-6d26-4b60-bacc-a920c6184dbb req-fe14a492-dfad-487a-97c7-24322e884b7f tempest-TaggedAttachmentsTest-659792418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:04:20 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-3447ab2b-6d26-4b60-bacc-a920c6184dbb req-fe14a492-dfad-487a-97c7-24322e884b7f tempest-TaggedAttachmentsTest-659792418 None] attachment_update completed successfully. Sep 22 11:04:30 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:04:30 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:04:52 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-45a1db7e-1ae5-455d-8118-cf123c35dbfe req-a9722736-c3d9-4b73-bdff-7348496822d9 tempest-TaggedAttachmentsTest-659792418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:04:52 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-45a1db7e-1ae5-455d-8118-cf123c35dbfe req-a9722736-c3d9-4b73-bdff-7348496822d9 tempest-TaggedAttachmentsTest-659792418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:04:52 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-45a1db7e-1ae5-455d-8118-cf123c35dbfe req-a9722736-c3d9-4b73-bdff-7348496822d9 tempest-TaggedAttachmentsTest-659792418 None] Terminate volume connection completed successfully. Sep 22 11:04:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-45a1db7e-1ae5-455d-8118-cf123c35dbfe req-a9722736-c3d9-4b73-bdff-7348496822d9 tempest-TaggedAttachmentsTest-659792418 None] Deleting attachment 3b91885a-ee25-4be6-8f35-d49e69906637. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:05:02 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:05:02 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:05:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:05:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:05:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:05:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:05:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:05:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:05:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:05:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.236s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:05:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:05:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] Acquiring lock "cinder-6ef39c08-e57c-4752-8599-3208b5800151-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:05:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] Lock "cinder-6ef39c08-e57c-4752-8599-3208b5800151-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:05:44 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:05:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] Acquiring lock "cinder-quobyte-6ef39c08-e57c-4752-8599-3208b5800151" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:05:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] Lock "cinder-quobyte-6ef39c08-e57c-4752-8599-3208b5800151" acquired by "delete_volume" :: waited 0.016s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:05:44 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[152d02de-0d3a-4181-9fea-78202b684d26]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:05:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6ef39c08-e57c-4752-8599-3208b5800151 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:05:44 devstack quobyte-client[83313]: System call of process 87941 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:05:44 devstack quobyte-client[83313]: System call of process 87941 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:05:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6ef39c08-e57c-4752-8599-3208b5800151" returned: 0 in 0.771s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:05:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6ef39c08-e57c-4752-8599-3208b5800151 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:05:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6ef39c08-e57c-4752-8599-3208b5800151" returned: 0 in 0.196s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:05:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] Lock "cinder-quobyte-6ef39c08-e57c-4752-8599-3208b5800151" released by "delete_volume" :: held 1.202s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:05:45 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] Created reservations ['3318801f-d8a1-4ed7-bc44-f0ca43d4b446', 'e2898b40-f914-4c75-bb1d-39f6a2ef3641', '21f8f5e8-db90-4d54-8ca5-5c18304f5a10', 'abe9e6a9-1e33-4f35-b4a2-da4523563881'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:05:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:05:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:05:45 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:05:45 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:05:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:05:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:05:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.137s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:05:46 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:05:46 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] Deleted volume successfully. Sep 22 11:05:46 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-0e8a2af9-a7bd-4358-aacb-5e89dbe5a697 tempest-TaggedAttachmentsTest-659792418 None] Lock "cinder-6ef39c08-e57c-4752-8599-3208b5800151-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:05:50 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-42853d54-79e0-4da4-a39d-75b03f110760 req-a43bfbae-e562-4286-900f-dd8d0b3002b6 tempest-TaggedBootDevicesTest-1069441050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:05:50 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-42853d54-79e0-4da4-a39d-75b03f110760 req-a43bfbae-e562-4286-900f-dd8d0b3002b6 tempest-TaggedBootDevicesTest-1069441050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:05:50 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-42853d54-79e0-4da4-a39d-75b03f110760 req-a43bfbae-e562-4286-900f-dd8d0b3002b6 tempest-TaggedBootDevicesTest-1069441050 None] Terminate volume connection completed successfully. Sep 22 11:05:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-42853d54-79e0-4da4-a39d-75b03f110760 req-a43bfbae-e562-4286-900f-dd8d0b3002b6 tempest-TaggedBootDevicesTest-1069441050 None] Deleting attachment 1c74e145-969b-4051-ac28-acaee52f5173. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:05:51 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-42853d54-79e0-4da4-a39d-75b03f110760 req-05227fe7-740d-4485-be90-d1d3f7fb0dc9 tempest-TaggedBootDevicesTest-1069441050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:05:51 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-42853d54-79e0-4da4-a39d-75b03f110760 req-05227fe7-740d-4485-be90-d1d3f7fb0dc9 tempest-TaggedBootDevicesTest-1069441050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:05:51 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-42853d54-79e0-4da4-a39d-75b03f110760 req-05227fe7-740d-4485-be90-d1d3f7fb0dc9 tempest-TaggedBootDevicesTest-1069441050 None] Terminate volume connection completed successfully. Sep 22 11:05:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-42853d54-79e0-4da4-a39d-75b03f110760 req-05227fe7-740d-4485-be90-d1d3f7fb0dc9 tempest-TaggedBootDevicesTest-1069441050 None] Deleting attachment 0f9d3d14-ff1e-43e6-81ff-faf5e9636ef2. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:05:51 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-42853d54-79e0-4da4-a39d-75b03f110760 req-f4ae8f45-d0f1-42e4-af6d-af755a3d6aac tempest-TaggedBootDevicesTest-1069441050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:05:51 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-42853d54-79e0-4da4-a39d-75b03f110760 req-f4ae8f45-d0f1-42e4-af6d-af755a3d6aac tempest-TaggedBootDevicesTest-1069441050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:05:51 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-42853d54-79e0-4da4-a39d-75b03f110760 req-f4ae8f45-d0f1-42e4-af6d-af755a3d6aac tempest-TaggedBootDevicesTest-1069441050 None] Terminate volume connection completed successfully. Sep 22 11:05:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-42853d54-79e0-4da4-a39d-75b03f110760 req-f4ae8f45-d0f1-42e4-af6d-af755a3d6aac tempest-TaggedBootDevicesTest-1069441050 None] Deleting attachment 8c136208-8b68-43cd-ba5a-a8cbdf7c5fca. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:06:00 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] Acquiring lock "cinder-d27e1eb7-5427-46e0-91b4-657dfac73ee6-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:06:00 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] Lock "cinder-d27e1eb7-5427-46e0-91b4-657dfac73ee6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:06:00 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:06:00 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] Acquiring lock "cinder-quobyte-d27e1eb7-5427-46e0-91b4-657dfac73ee6" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:06:00 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] Lock "cinder-quobyte-d27e1eb7-5427-46e0-91b4-657dfac73ee6" acquired by "delete_volume" :: waited 0.011s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:06:00 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1f244f-d6bf-4ea7-b954-fb75d3478a4c]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:06:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d27e1eb7-5427-46e0-91b4-657dfac73ee6 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:01 devstack quobyte-client[83313]: System call of process 87966 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:01 devstack quobyte-client[83313]: System call of process 87966 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:01 devstack quobyte-client[83313]: System call of process 87966 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d27e1eb7-5427-46e0-91b4-657dfac73ee6" returned: 0 in 0.665s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d27e1eb7-5427-46e0-91b4-657dfac73ee6 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d27e1eb7-5427-46e0-91b4-657dfac73ee6" returned: 0 in 0.149s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:01 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] Lock "cinder-quobyte-d27e1eb7-5427-46e0-91b4-657dfac73ee6" released by "delete_volume" :: held 1.039s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:06:01 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] Created reservations ['b8e81082-291e-4b3d-832b-356777aa4793', 'd93e4e06-4aa2-48a4-8f41-1cacdf3b481a', '16f89bef-6774-48a9-b365-f3a3e4ad6181', '42f90f27-6cb0-479a-bfed-01eaa38d4dc6'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:06:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:06:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:06:01 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:06:01 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:06:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:06:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.126s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:02 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:06:02 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] Deleted volume successfully. Sep 22 11:06:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8c2e25cf-f244-42c4-a3d6-a729f6146356 tempest-TaggedBootDevicesTest-1069441050 None] Lock "cinder-d27e1eb7-5427-46e0-91b4-657dfac73ee6-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:06:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] Acquiring lock "cinder-13500a63-b091-43d6-8a16-808858908ced-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:06:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] Lock "cinder-13500a63-b091-43d6-8a16-808858908ced-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:06:03 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:06:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] Acquiring lock "cinder-quobyte-13500a63-b091-43d6-8a16-808858908ced" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:06:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] Lock "cinder-quobyte-13500a63-b091-43d6-8a16-808858908ced" acquired by "delete_volume" :: waited 0.016s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:06:03 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d9fba2-b0b5-43e5-8568-4103999cc87a]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:06:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-13500a63-b091-43d6-8a16-808858908ced {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-13500a63-b091-43d6-8a16-808858908ced" returned: 0 in 0.579s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-13500a63-b091-43d6-8a16-808858908ced {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-13500a63-b091-43d6-8a16-808858908ced" returned: 0 in 0.168s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] Lock "cinder-quobyte-13500a63-b091-43d6-8a16-808858908ced" released by "delete_volume" :: held 0.965s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:06:04 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] Created reservations ['f147dc41-78e2-4178-892f-a60391e12037', '254290c9-a1f5-4f7d-afad-a44b9ecb4db9', '7625f564-f935-4266-9cba-b1762163d8fc', '4439c00e-330a-45e2-a998-ead8ecbdf9d3'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:06:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:06:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:06:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:06:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:06:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:06:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.151s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:04 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:06:04 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] Deleted volume successfully. Sep 22 11:06:05 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e44817b6-2bc9-46a5-ae42-66c66fefc1bb tempest-TaggedBootDevicesTest-1069441050 None] Lock "cinder-13500a63-b091-43d6-8a16-808858908ced-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:06:05 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] Acquiring lock "cinder-4891397a-84f2-493e-8537-68f79b9dba6a-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:06:05 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] Lock "cinder-4891397a-84f2-493e-8537-68f79b9dba6a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:06:05 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:06:05 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] Acquiring lock "cinder-quobyte-4891397a-84f2-493e-8537-68f79b9dba6a" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:06:05 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] Lock "cinder-quobyte-4891397a-84f2-493e-8537-68f79b9dba6a" acquired by "delete_volume" :: waited 0.014s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:06:05 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[077a4974-732c-451a-a8df-f4db05c6efea]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:06:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:06 devstack quobyte-client[83313]: System call of process 88001 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:06 devstack quobyte-client[83313]: System call of process 88001 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a" returned: 0 in 0.811s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:07 devstack quobyte-client[83313]: System call of process 88025 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a" returned: 1 in 0.778s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:06:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4891397a-84f2-493e-8537-68f79b9dba6a" returned: 0 in 0.129s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:07 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] Lock "cinder-quobyte-4891397a-84f2-493e-8537-68f79b9dba6a" released by "delete_volume" :: held 2.229s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:06:08 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] Created reservations ['e61b0b3a-3b4b-401d-be6c-43003907c766', 'ee4766bc-cec6-46a7-b663-a5019ef8b810', '27631790-eb05-4747-a748-172322ccd3ff', 'ff658920-2868-4aa2-b7a0-366fe35c9e7e'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:06:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:06:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:06:08 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:06:08 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:06:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:06:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.145s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:08 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:06:08 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] Deleted volume successfully. Sep 22 11:06:09 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4f5a6418-958d-4c90-b3fc-e889a48e0447 tempest-TaggedBootDevicesTest-1069441050 None] Lock "cinder-4891397a-84f2-493e-8537-68f79b9dba6a-delete_volume" released by "delete_volume" :: held 3.608s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:06:15 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:06:15 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:06:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Flow 'volume_create_manager' (47f30bc9-c211-4434-822c-a9f12bac25bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:06:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca255d2-1d30-4b72-a52b-6798b35aafa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:06:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca255d2-1d30-4b72-a52b-6798b35aafa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1972786122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0fba2ae-eeb5-4b79-8d43-952d4842826b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acaed8fcef1c46a4a9a5037ef028f730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:06:15Z,use_quota=True,user_id='0087695291fe4f1c809be7c38ecb5564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:06:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eab865e-9178-4e4a-a5f8-d6ede1e22246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:06:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eab865e-9178-4e4a-a5f8-d6ede1e22246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:06:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a3482d-3711-43c8-9fb3-27017853f785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:06:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a3482d-3711-43c8-9fb3-27017853f785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0fba2ae-eeb5-4b79-8d43-952d4842826b', 'volume_name': 'volume-e0fba2ae-eeb5-4b79-8d43-952d4842826b', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:06:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebcbaed4-bb79-4da1-ba95-e76360aeb616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:06:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebcbaed4-bb79-4da1-ba95-e76360aeb616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:06:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a53bef-9e3e-467c-90b5-2070a5f058b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:06:15 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Volume e0fba2ae-eeb5-4b79-8d43-952d4842826b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0fba2ae-eeb5-4b79-8d43-952d4842826b', 'volume_size': 1} Sep 22 11:06:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:06:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:06:15 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1972786122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0fba2ae-eeb5-4b79-8d43-952d4842826b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acaed8fcef1c46a4a9a5037ef028f730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:06:15Z,use_quota=True,user_id='0087695291fe4f1c809be7c38ecb5564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:06:15 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Creating volume e0fba2ae-eeb5-4b79-8d43-952d4842826b {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:06:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:06:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:06:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:06:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:06:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:06:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:06:16 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:06:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e0fba2ae-eeb5-4b79-8d43-952d4842826b 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:16 devstack quobyte-client[83313]: System call of process 88038 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:16 devstack quobyte-client[83313]: System call of process 88038 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:16 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=12, name=volume-e0fba2ae-eeb5-4b79-8d43-952d4842826b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:06:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e0fba2ae-eeb5-4b79-8d43-952d4842826b 1073741824" returned: 0 in 1.041s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e0fba2ae-eeb5-4b79-8d43-952d4842826b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:06:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:06:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:06:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:06:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:06:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:06:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e0fba2ae-eeb5-4b79-8d43-952d4842826b" returned: 0 in 0.657s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] <== create_volume: return (1857ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:06:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:06:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.876s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:18 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:06:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a53bef-9e3e-467c-90b5-2070a5f058b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0fba2ae-eeb5-4b79-8d43-952d4842826b', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:06:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258f42c0-f718-4ef3-9c0a-654fc5ad193f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:06:19 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Volume volume-e0fba2ae-eeb5-4b79-8d43-952d4842826b (e0fba2ae-eeb5-4b79-8d43-952d4842826b): created successfully Sep 22 11:06:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258f42c0-f718-4ef3-9c0a-654fc5ad193f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:06:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Flow 'volume_create_manager' (47f30bc9-c211-4434-822c-a9f12bac25bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:06:19 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-1cc03e94-24f7-4c9b-a775-17e9301ced30 tempest-AttachVolumeShelveTestJSON-1546792471 None] Created volume successfully. Sep 22 11:06:29 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=24,cinder:INSERT=10,cinder:UPDATE=32 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:06:29 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=37,cinder:SELECT=25,cinder:INSERT=6,cinder:DELETE=5 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:06:35 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Flow 'volume_create_manager' (091e358a-38e3-4b12-90fa-06c9f885a028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337f6bb6-13b8-4c93-a5b5-eb6cecfe9649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337f6bb6-13b8-4c93-a5b5-eb6cecfe9649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-139305992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c5eca3-56a8-4204-9490-a08a96af256d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4c24319bac453f8438b2a17933a27e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:06:35Z,use_quota=True,user_id='9e56d626ea404c19b2d91301c761a6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3398186-e84a-4595-9921-31019c6718f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3398186-e84a-4595-9921-31019c6718f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28544271-e1ed-42df-8c17-c90bcf3201ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28544271-e1ed-42df-8c17-c90bcf3201ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69c5eca3-56a8-4204-9490-a08a96af256d', 'volume_name': 'volume-69c5eca3-56a8-4204-9490-a08a96af256d', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95803b96-796c-46e3-b70e-d3a67ac929b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95803b96-796c-46e3-b70e-d3a67ac929b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7719e75a-5288-4c70-a0bc-2d39cede4a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:06:35 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Volume 69c5eca3-56a8-4204-9490-a08a96af256d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69c5eca3-56a8-4204-9490-a08a96af256d', 'volume_size': 1} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-139305992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c5eca3-56a8-4204-9490-a08a96af256d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4c24319bac453f8438b2a17933a27e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:06:35Z,use_quota=True,user_id='9e56d626ea404c19b2d91301c761a6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Creating volume 69c5eca3-56a8-4204-9490-a08a96af256d {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:06:35 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:35 devstack quobyte-client[83313]: System call of process 88109 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:35 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=13, name=volume-69c5eca3-56a8-4204-9490-a08a96af256d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d 1073741824" returned: 0 in 0.401s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d" returned: 0 in 0.088s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] <== create_volume: return (560ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:06:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.575s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:06:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7719e75a-5288-4c70-a0bc-2d39cede4a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69c5eca3-56a8-4204-9490-a08a96af256d', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:06:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c24443c-82e8-4b7b-9857-45f19d00cb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:06:36 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Volume volume-69c5eca3-56a8-4204-9490-a08a96af256d (69c5eca3-56a8-4204-9490-a08a96af256d): created successfully Sep 22 11:06:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c24443c-82e8-4b7b-9857-45f19d00cb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:06:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Flow 'volume_create_manager' (091e358a-38e3-4b12-90fa-06c9f885a028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:06:36 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-f5c597a4-d38b-4c35-ad67-278b1c1fbcf0 req-b9009cd3-ea21-4ff1-ba75-5a7532f75263 tempest-VolumesSnapshotsTestJSON-1313669083 None] Created volume successfully. Sep 22 11:06:38 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:06:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:06:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:06:38 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] Creating offline snapshot a9367d9f-b637-424e-aa86-f3c09b123b67 of volume 69c5eca3-56a8-4204-9490-a08a96af256d {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:06:38 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da53277-3fe0-4564-916d-b9f351b1301b]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:06:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d" returned: 0 in 1.055s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.a9367d9f-b637-424e-aa86-f3c09b123b67 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:40 devstack quobyte-client[83313]: System call of process 88122 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:40 devstack quobyte-client[83313]: System call of process 88122 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:40 devstack quobyte-client[83313]: System call of process 88122 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:40 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=14, name=volume-69c5eca3-56a8-4204-9490-a08a96af256d.a9367d9f-b637-424e-aa86-f3c09b123b67, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:06:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.a9367d9f-b637-424e-aa86-f3c09b123b67 1G" returned: 0 in 0.537s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] Running cmd (subprocess): qemu-img rebase -u -b volume-69c5eca3-56a8-4204-9490-a08a96af256d -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.a9367d9f-b637-424e-aa86-f3c09b123b67 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:40 devstack quobyte-client[83313]: System call of process 88128 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] CMD "qemu-img rebase -u -b volume-69c5eca3-56a8-4204-9490-a08a96af256d -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.a9367d9f-b637-424e-aa86-f3c09b123b67" returned: 0 in 0.261s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.a9367d9f-b637-424e-aa86-f3c09b123b67 is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:06:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.a9367d9f-b637-424e-aa86-f3c09b123b67 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.a9367d9f-b637-424e-aa86-f3c09b123b67" returned: 0 in 0.226s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:06:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.a9367d9f-b637-424e-aa86-f3c09b123b67 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.a9367d9f-b637-424e-aa86-f3c09b123b67" returned: 0 in 0.319s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.info" returned: 0 in 0.167s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:06:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.info" returned: 0 in 0.157s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.699s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:06:42 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-40726379-e8c0-4821-b1aa-b0268a5926fa req-29cbe6e5-fa7f-4efa-9cbf-1a9b30705480 tempest-VolumesSnapshotsTestJSON-1313669083 None] Create snapshot completed successfully Sep 22 11:06:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] Acquiring lock "cinder-a9367d9f-b637-424e-aa86-f3c09b123b67-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:06:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] Lock "cinder-a9367d9f-b637-424e-aa86-f3c09b123b67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:06:43 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:06:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] Acquiring lock "cinder-quobyte-69c5eca3-56a8-4204-9490-a08a96af256d" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:06:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] Lock "cinder-quobyte-69c5eca3-56a8-4204-9490-a08a96af256d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:06:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] Acquiring lock "cinder-quobyte-a9367d9f-b637-424e-aa86-f3c09b123b67" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:06:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] Lock "cinder-quobyte-a9367d9f-b637-424e-aa86-f3c09b123b67" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:06:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] Deleting offline snapshot a9367d9f-b637-424e-aa86-f3c09b123b67 of volume 69c5eca3-56a8-4204-9490-a08a96af256d {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:06:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] snapshot_file for this snap is: volume-69c5eca3-56a8-4204-9490-a08a96af256d.a9367d9f-b637-424e-aa86-f3c09b123b67 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:06:43 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dbc138-5632-4b23-bf76-a75353fffd8e]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:06:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.a9367d9f-b637-424e-aa86-f3c09b123b67 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:44 devstack quobyte-client[83313]: System call of process 88144 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:44 devstack quobyte-client[83313]: System call of process 88144 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:44 devstack quobyte-client[83313]: System call of process 88144 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.a9367d9f-b637-424e-aa86-f3c09b123b67" returned: 0 in 0.560s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69c5eca3-56a8-4204-9490-a08a96af256d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:06:44 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[432d564c-2e16-4be3-aa8e-8ff85de67590]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:06:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d" returned: 0 in 0.661s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.a9367d9f-b637-424e-aa86-f3c09b123b67 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:45 devstack quobyte-client[83313]: System call of process 88151 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.a9367d9f-b637-424e-aa86-f3c09b123b67" returned: 0 in 0.324s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.a9367d9f-b637-424e-aa86-f3c09b123b67 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d.a9367d9f-b637-424e-aa86-f3c09b123b67" returned: 0 in 0.122s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] Lock "cinder-quobyte-a9367d9f-b637-424e-aa86-f3c09b123b67" released by "_delete_snapshot" :: held 2.003s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:06:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] Lock "cinder-quobyte-69c5eca3-56a8-4204-9490-a08a96af256d" released by "delete_snapshot" :: held 2.031s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:06:45 devstack cinder-volume[83310]: WARNING cinder.quota [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:06:45 devstack cinder-volume[83310]: DEBUG cinder.quota [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] Created reservations ['2c29b90b-84c2-4673-882b-46a7c2bdb90b', '61fdba0c-d729-4043-806d-e2b65c9d6ea9', '2ece98cf-83cd-43f6-b451-5daf3dce5df4', '61479d7d-6ef2-44c3-9040-255e6551e512'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:06:46 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] Delete snapshot completed successfully. Sep 22 11:06:46 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-56aa9f14-77ae-4964-9fd1-caa248ee2150 req-93cf7d58-7b2f-4261-8206-dc96bb4b44a2 tempest-VolumesSnapshotsTestJSON-1313669083 None] Lock "cinder-a9367d9f-b637-424e-aa86-f3c09b123b67-delete_snapshot" released by "delete_snapshot" :: held 2.622s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:06:46 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] Acquiring lock "cinder-69c5eca3-56a8-4204-9490-a08a96af256d-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:06:46 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] Lock "cinder-69c5eca3-56a8-4204-9490-a08a96af256d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:06:46 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:06:46 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] Acquiring lock "cinder-quobyte-69c5eca3-56a8-4204-9490-a08a96af256d" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:06:47 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] Lock "cinder-quobyte-69c5eca3-56a8-4204-9490-a08a96af256d" acquired by "delete_volume" :: waited 0.030s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:06:47 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac334266-705b-4340-bee3-3af045346489]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:06:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:47 devstack quobyte-client[83313]: System call of process 88161 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d" returned: 0 in 0.671s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69c5eca3-56a8-4204-9490-a08a96af256d" returned: 0 in 0.176s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] Lock "cinder-quobyte-69c5eca3-56a8-4204-9490-a08a96af256d" released by "delete_volume" :: held 1.289s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:06:48 devstack cinder-volume[83310]: DEBUG cinder.quota [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] Created reservations ['c78fd45b-c5c3-45ce-a427-88b01a10be11', '30f7eeaa-94ae-4c78-aa8c-422db276130c', '66e54f20-e9d9-489e-acb6-c6a1f5f52970', 'dda4d563-ad77-4adb-93f9-f07c665c00e3'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:06:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:06:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:06:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:06:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:06:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:06:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-cce625e6-5fae-451e-983f-768747dccecf req-eb8237c0-9055-49e3-af17-767cb88536b5 tempest-AttachVolumeShelveTestJSON-1546792471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:06:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-cce625e6-5fae-451e-983f-768747dccecf req-eb8237c0-9055-49e3-af17-767cb88536b5 tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:06:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.471s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:49 devstack cinder-volume[83310]: DEBUG cinder.manager [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:06:49 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] Deleted volume successfully. Sep 22 11:06:49 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f835eae-eb61-4c09-95ed-527a4aa31daf]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:06:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-cce625e6-5fae-451e-983f-768747dccecf req-eb8237c0-9055-49e3-af17-767cb88536b5 tempest-AttachVolumeShelveTestJSON-1546792471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e0fba2ae-eeb5-4b79-8d43-952d4842826b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-64bf576e-d7a7-4ef9-9699-5496e1d62810 req-ee6fe8b8-fc1a-4587-9f16-c27bdb5c5b1f tempest-VolumesSnapshotsTestJSON-1313669083 None] Lock "cinder-69c5eca3-56a8-4204-9490-a08a96af256d-delete_volume" released by "delete_volume" :: held 3.680s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:06:51 devstack quobyte-client[83313]: System call of process 88186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:51 devstack quobyte-client[83313]: System call of process 88186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:06:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-cce625e6-5fae-451e-983f-768747dccecf req-eb8237c0-9055-49e3-af17-767cb88536b5 tempest-AttachVolumeShelveTestJSON-1546792471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e0fba2ae-eeb5-4b79-8d43-952d4842826b" returned: 0 in 1.472s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-cce625e6-5fae-451e-983f-768747dccecf req-eb8237c0-9055-49e3-af17-767cb88536b5 tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.603s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:06:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-cce625e6-5fae-451e-983f-768747dccecf req-eb8237c0-9055-49e3-af17-767cb88536b5 tempest-AttachVolumeShelveTestJSON-1546792471 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-e0fba2ae-eeb5-4b79-8d43-952d4842826b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b32c8ae4-a526-448c-93ec-28a53f022483', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:06:51 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-cce625e6-5fae-451e-983f-768747dccecf req-eb8237c0-9055-49e3-af17-767cb88536b5 tempest-AttachVolumeShelveTestJSON-1546792471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:06:52 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-cce625e6-5fae-451e-983f-768747dccecf req-eb8237c0-9055-49e3-af17-767cb88536b5 tempest-AttachVolumeShelveTestJSON-1546792471 None] attachment_update completed successfully. Sep 22 11:06:56 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Flow 'volume_create_manager' (9c4833c3-3c35-40b2-b815-d0306c5ae01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4a4600-1004-4ae3-8156-70fde9184872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4a4600-1004-4ae3-8156-70fde9184872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-12818675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0359926a-62d3-438b-9a1a-284fd7136cc0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3632d7e7e10f4194afef916a7d168c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:06:57Z,use_quota=True,user_id='799f158f3a7e4a1aab9ac33a6699c12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e113b8e1-717c-49b0-9a70-58e4749733bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e113b8e1-717c-49b0-9a70-58e4749733bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd2e53f-a8b9-4644-8e0e-81d024d94f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd2e53f-a8b9-4644-8e0e-81d024d94f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0359926a-62d3-438b-9a1a-284fd7136cc0', 'volume_name': 'volume-0359926a-62d3-438b-9a1a-284fd7136cc0', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf17fb34-0f25-4e84-8c78-9bd26afffc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf17fb34-0f25-4e84-8c78-9bd26afffc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6c2ac5-88ed-4611-83b9-5a1cbde63831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:06:56 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Volume 0359926a-62d3-438b-9a1a-284fd7136cc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0359926a-62d3-438b-9a1a-284fd7136cc0', 'volume_size': 1} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-12818675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0359926a-62d3-438b-9a1a-284fd7136cc0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3632d7e7e10f4194afef916a7d168c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:06:57Z,use_quota=True,user_id='799f158f3a7e4a1aab9ac33a6699c12b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Creating volume 0359926a-62d3-438b-9a1a-284fd7136cc0 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:06:56 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:06:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0359926a-62d3-438b-9a1a-284fd7136cc0 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:57 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=16, name=volume-0359926a-62d3-438b-9a1a-284fd7136cc0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:06:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0359926a-62d3-438b-9a1a-284fd7136cc0 1073741824" returned: 0 in 0.483s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0359926a-62d3-438b-9a1a-284fd7136cc0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:06:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0359926a-62d3-438b-9a1a-284fd7136cc0" returned: 0 in 0.187s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:06:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] <== create_volume: return (745ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:06:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:06:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6c2ac5-88ed-4611-83b9-5a1cbde63831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0359926a-62d3-438b-9a1a-284fd7136cc0', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:06:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27b3ff6-2c45-4d79-8b64-f7e3c44289eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:06:58 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Volume volume-0359926a-62d3-438b-9a1a-284fd7136cc0 (0359926a-62d3-438b-9a1a-284fd7136cc0): created successfully Sep 22 11:06:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27b3ff6-2c45-4d79-8b64-f7e3c44289eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:06:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Flow 'volume_create_manager' (9c4833c3-3c35-40b2-b815-d0306c5ae01d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:06:58 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-2f189dee-0772-4625-9afc-d059b3811269 req-dbfac4d9-4510-45ce-8aac-5106bb13fae0 tempest-VolumesGetTestJSON-239744053 None] Created volume successfully. Sep 22 11:06:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] Acquiring lock "cinder-0359926a-62d3-438b-9a1a-284fd7136cc0-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:06:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] Lock "cinder-0359926a-62d3-438b-9a1a-284fd7136cc0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:06:59 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:06:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] Acquiring lock "cinder-quobyte-0359926a-62d3-438b-9a1a-284fd7136cc0" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:06:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] Lock "cinder-quobyte-0359926a-62d3-438b-9a1a-284fd7136cc0" acquired by "delete_volume" :: waited 0.010s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:06:59 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[7877c2bf-1a58-4048-a142-a548a5f33633]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:06:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0359926a-62d3-438b-9a1a-284fd7136cc0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:00 devstack quobyte-client[83313]: System call of process 88262 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:07:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0359926a-62d3-438b-9a1a-284fd7136cc0" returned: 0 in 0.988s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0359926a-62d3-438b-9a1a-284fd7136cc0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0359926a-62d3-438b-9a1a-284fd7136cc0" returned: 0 in 0.168s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:00 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] Lock "cinder-quobyte-0359926a-62d3-438b-9a1a-284fd7136cc0" released by "delete_volume" :: held 1.347s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:07:01 devstack cinder-volume[83310]: DEBUG cinder.quota [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] Created reservations ['d22eeb62-77cc-4d11-a081-7720532530d2', '29757bf0-9eb7-431f-9db8-57afacb1b482', '00edb9b1-a109-472f-98f3-7600894fb7ea', 'e4f86c25-06ed-4927-825b-71a1804f2013'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:07:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:07:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:07:02 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:07:02 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:07:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:07:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.395s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:02 devstack cinder-volume[83310]: DEBUG cinder.manager [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:07:02 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] Deleted volume successfully. Sep 22 11:07:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-13ff69b4-6b21-4004-87fb-2588a1fea73a req-23529d88-27a1-4d13-95b4-71cf12c0d841 tempest-VolumesGetTestJSON-239744053 None] Lock "cinder-0359926a-62d3-438b-9a1a-284fd7136cc0-delete_volume" released by "delete_volume" :: held 4.122s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=21,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=6 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:07:12 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Flow 'volume_create_manager' (f08d85ee-2d49-480d-9143-80e2444fdaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce0a989c-daf5-428a-834b-300f639193fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce0a989c-daf5-428a-834b-300f639193fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1312968920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c7aee31-ffa4-41d6-ad43-2b978967cf1e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b2dee2367e24949b3241da189cd2ba8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:07:12Z,use_quota=True,user_id='074c54dbcd44457581f40c307b81e452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93628824-121b-4d3c-837d-5c4f408070f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93628824-121b-4d3c-837d-5c4f408070f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d92523-1c7c-4ae6-8110-50ff93a84cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d92523-1c7c-4ae6-8110-50ff93a84cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c7aee31-ffa4-41d6-ad43-2b978967cf1e', 'volume_name': 'volume-1c7aee31-ffa4-41d6-ad43-2b978967cf1e', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fc6464-a99e-45d7-9337-4aa22d715e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fc6464-a99e-45d7-9337-4aa22d715e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee34fe1e-abb6-4406-a4a2-777c9f18c019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:12 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Volume 1c7aee31-ffa4-41d6-ad43-2b978967cf1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c7aee31-ffa4-41d6-ad43-2b978967cf1e', 'volume_size': 1} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1312968920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c7aee31-ffa4-41d6-ad43-2b978967cf1e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b2dee2367e24949b3241da189cd2ba8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:07:12Z,use_quota=True,user_id='074c54dbcd44457581f40c307b81e452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Creating volume 1c7aee31-ffa4-41d6-ad43-2b978967cf1e {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:07:12 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:07:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1c7aee31-ffa4-41d6-ad43-2b978967cf1e 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:13 devstack quobyte-client[83313]: System call of process 88326 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:07:13 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=17, name=volume-1c7aee31-ffa4-41d6-ad43-2b978967cf1e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:07:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1c7aee31-ffa4-41d6-ad43-2b978967cf1e 1073741824" returned: 0 in 0.724s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1c7aee31-ffa4-41d6-ad43-2b978967cf1e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1c7aee31-ffa4-41d6-ad43-2b978967cf1e" returned: 0 in 0.254s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:13 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] <== create_volume: return (1107ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:07:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:07:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee34fe1e-abb6-4406-a4a2-777c9f18c019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c7aee31-ffa4-41d6-ad43-2b978967cf1e', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b973aea8-1f2e-400f-b0a6-6040a3b2913f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:14 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Volume volume-1c7aee31-ffa4-41d6-ad43-2b978967cf1e (1c7aee31-ffa4-41d6-ad43-2b978967cf1e): created successfully Sep 22 11:07:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b973aea8-1f2e-400f-b0a6-6040a3b2913f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Flow 'volume_create_manager' (f08d85ee-2d49-480d-9143-80e2444fdaeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:07:14 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-3004b800-1bf8-42f8-858c-71190ec308bc tempest-VolumesTestJSON-1051752300 None] Created volume successfully. Sep 22 11:07:16 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Flow 'volume_create_manager' (9514ae5e-8fd0-4ae7-a244-50045d1bc5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2a79ff-de24-4d40-b93f-cfb57a3e95d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2a79ff-de24-4d40-b93f-cfb57a3e95d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-582170539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61fc658-7296-4b00-9961-e75b985b9c34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b2dee2367e24949b3241da189cd2ba8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:07:16Z,use_quota=True,user_id='074c54dbcd44457581f40c307b81e452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d536fc8d-49ca-417c-a8f1-4f9b597b2190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d536fc8d-49ca-417c-a8f1-4f9b597b2190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b608e263-7aa2-4f74-951d-5fa3c01caf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b608e263-7aa2-4f74-951d-5fa3c01caf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f61fc658-7296-4b00-9961-e75b985b9c34', 'volume_name': 'volume-f61fc658-7296-4b00-9961-e75b985b9c34', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce3a9878-d0dd-4527-aaf6-738aa75dac0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce3a9878-d0dd-4527-aaf6-738aa75dac0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76fbb4c0-429c-49be-a258-49a0fce4d409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:16 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Volume f61fc658-7296-4b00-9961-e75b985b9c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f61fc658-7296-4b00-9961-e75b985b9c34', 'volume_size': 1} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-582170539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61fc658-7296-4b00-9961-e75b985b9c34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b2dee2367e24949b3241da189cd2ba8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:07:16Z,use_quota=True,user_id='074c54dbcd44457581f40c307b81e452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Creating volume f61fc658-7296-4b00-9961-e75b985b9c34 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:07:16 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:07:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f61fc658-7296-4b00-9961-e75b985b9c34 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:17 devstack quobyte-client[83313]: System call of process 88340 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:07:17 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=18, name=volume-f61fc658-7296-4b00-9961-e75b985b9c34, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:07:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:07:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:07:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.028s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:07:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:07:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:07:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.066s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:07:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f61fc658-7296-4b00-9961-e75b985b9c34 1073741824" returned: 0 in 0.991s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f61fc658-7296-4b00-9961-e75b985b9c34 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.426s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:18 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:07:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f61fc658-7296-4b00-9961-e75b985b9c34" returned: 0 in 0.463s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] <== create_volume: return (1568ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:07:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:07:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76fbb4c0-429c-49be-a258-49a0fce4d409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f61fc658-7296-4b00-9961-e75b985b9c34', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606aa04b-cbe7-40dd-8561-8c513b9cf451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:18 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Volume volume-f61fc658-7296-4b00-9961-e75b985b9c34 (f61fc658-7296-4b00-9961-e75b985b9c34): created successfully Sep 22 11:07:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606aa04b-cbe7-40dd-8561-8c513b9cf451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Flow 'volume_create_manager' (9514ae5e-8fd0-4ae7-a244-50045d1bc5df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:07:18 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-465c6b4c-548a-4dda-8db9-455f763ef9d8 tempest-VolumesTestJSON-1051752300 None] Created volume successfully. Sep 22 11:07:20 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:07:20 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Flow 'volume_create_manager' (ebae0bfb-b058-4448-981d-997cf7344c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968b6988-e633-4ab5-bc89-e8c7307577d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968b6988-e633-4ab5-bc89-e8c7307577d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-605733788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832654ff-1687-406a-bc16-a4bb181d4e0c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b2dee2367e24949b3241da189cd2ba8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:07:20Z,use_quota=True,user_id='074c54dbcd44457581f40c307b81e452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfda86dc-82f8-44c7-8682-5ed589246b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfda86dc-82f8-44c7-8682-5ed589246b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6466af16-36f9-4c50-82f6-8fc30ef5cbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6466af16-36f9-4c50-82f6-8fc30ef5cbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '832654ff-1687-406a-bc16-a4bb181d4e0c', 'volume_name': 'volume-832654ff-1687-406a-bc16-a4bb181d4e0c', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1731d6db-7c61-4bd3-8288-e08bcf3d8be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1731d6db-7c61-4bd3-8288-e08bcf3d8be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf6cfb8-1e2f-416f-8cb5-ff68acdc0f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:21 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Volume 832654ff-1687-406a-bc16-a4bb181d4e0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-832654ff-1687-406a-bc16-a4bb181d4e0c', 'volume_size': 1} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-605733788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832654ff-1687-406a-bc16-a4bb181d4e0c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b2dee2367e24949b3241da189cd2ba8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:07:20Z,use_quota=True,user_id='074c54dbcd44457581f40c307b81e452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Creating volume 832654ff-1687-406a-bc16-a4bb181d4e0c {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:07:21 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-832654ff-1687-406a-bc16-a4bb181d4e0c 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:21 devstack quobyte-client[83313]: System call of process 88352 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:07:21 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=19, name=volume-832654ff-1687-406a-bc16-a4bb181d4e0c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:07:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-832654ff-1687-406a-bc16-a4bb181d4e0c 1073741824" returned: 0 in 0.499s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-832654ff-1687-406a-bc16-a4bb181d4e0c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-832654ff-1687-406a-bc16-a4bb181d4e0c" returned: 0 in 0.237s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] <== create_volume: return (874ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:07:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:07:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf6cfb8-1e2f-416f-8cb5-ff68acdc0f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-832654ff-1687-406a-bc16-a4bb181d4e0c', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423cb1b3-e90d-4a6f-82bf-1362c021ab3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:22 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Volume volume-832654ff-1687-406a-bc16-a4bb181d4e0c (832654ff-1687-406a-bc16-a4bb181d4e0c): created successfully Sep 22 11:07:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423cb1b3-e90d-4a6f-82bf-1362c021ab3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Flow 'volume_create_manager' (ebae0bfb-b058-4448-981d-997cf7344c7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:07:22 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-a3c299b6-c8d4-4eeb-8d25-c109c54a9968 tempest-VolumesTestJSON-1051752300 None] Created volume successfully. Sep 22 11:07:24 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] Acquiring lock "cinder-832654ff-1687-406a-bc16-a4bb181d4e0c-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:07:24 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] Lock "cinder-832654ff-1687-406a-bc16-a4bb181d4e0c-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:07:24 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:07:24 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] Acquiring lock "cinder-quobyte-832654ff-1687-406a-bc16-a4bb181d4e0c" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:07:24 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] Lock "cinder-quobyte-832654ff-1687-406a-bc16-a4bb181d4e0c" acquired by "delete_volume" :: waited 0.013s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:07:24 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8367367d-c75b-4a0c-a1f7-9819a95bb950]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:07:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-832654ff-1687-406a-bc16-a4bb181d4e0c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-832654ff-1687-406a-bc16-a4bb181d4e0c" returned: 0 in 0.620s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-832654ff-1687-406a-bc16-a4bb181d4e0c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-832654ff-1687-406a-bc16-a4bb181d4e0c" returned: 0 in 0.158s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:25 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] Lock "cinder-quobyte-832654ff-1687-406a-bc16-a4bb181d4e0c" released by "delete_volume" :: held 1.013s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:07:26 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] Created reservations ['44d20ab3-5368-4be3-a75a-2f71720ed8e4', '3a51459f-b316-4622-85aa-53f9b83cfbee', '577d86c0-1098-416b-9b07-b40fa917b702', 'cbf7ece0-3662-483b-83ea-c43708c0661a'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:07:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:07:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:07:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:07:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:07:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:07:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.091s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:26 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:07:26 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] Deleted volume successfully. Sep 22 11:07:26 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6af7bebf-0dc4-45c0-b85b-40e5e449a7f2 tempest-VolumesTestJSON-1051752300 None] Lock "cinder-832654ff-1687-406a-bc16-a4bb181d4e0c-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:07:26 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] Acquiring lock "cinder-f61fc658-7296-4b00-9961-e75b985b9c34-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:07:26 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] Lock "cinder-f61fc658-7296-4b00-9961-e75b985b9c34-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:07:27 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:07:27 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] Acquiring lock "cinder-quobyte-f61fc658-7296-4b00-9961-e75b985b9c34" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:07:27 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] Lock "cinder-quobyte-f61fc658-7296-4b00-9961-e75b985b9c34" acquired by "delete_volume" :: waited 0.011s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:07:27 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[422f5ff4-abb8-4e10-b12a-f430e3352c6b]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:07:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f61fc658-7296-4b00-9961-e75b985b9c34 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:27 devstack quobyte-client[83313]: System call of process 88650 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:07:27 devstack quobyte-client[83313]: System call of process 88650 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:07:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f61fc658-7296-4b00-9961-e75b985b9c34" returned: 0 in 0.640s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f61fc658-7296-4b00-9961-e75b985b9c34 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f61fc658-7296-4b00-9961-e75b985b9c34" returned: 0 in 0.262s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:28 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] Lock "cinder-quobyte-f61fc658-7296-4b00-9961-e75b985b9c34" released by "delete_volume" :: held 1.175s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:07:28 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] Created reservations ['db566d44-5dfa-425d-9cd5-2d68a86ce925', '95947762-3b35-43d6-bfe0-e1d9a392a23b', 'a23e2504-b083-4258-82cc-cc89caab0f77', '781763d1-29db-4ac2-891a-b86076393e71'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:07:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:07:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:07:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:07:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:07:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:07:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.146s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:29 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:07:29 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] Deleted volume successfully. Sep 22 11:07:29 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] Acquiring lock "cinder-1c7aee31-ffa4-41d6-ad43-2b978967cf1e-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:07:29 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-dfdfdc7a-2340-4c85-9289-1f31bd3d397d tempest-VolumesTestJSON-1051752300 None] Lock "cinder-f61fc658-7296-4b00-9961-e75b985b9c34-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:07:29 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] Lock "cinder-1c7aee31-ffa4-41d6-ad43-2b978967cf1e-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:07:29 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=44,cinder:SELECT=41,cinder:DELETE=5,cinder:INSERT=6 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:07:30 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:07:30 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] Acquiring lock "cinder-quobyte-1c7aee31-ffa4-41d6-ad43-2b978967cf1e" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:07:30 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] Lock "cinder-quobyte-1c7aee31-ffa4-41d6-ad43-2b978967cf1e" acquired by "delete_volume" :: waited 0.024s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:07:30 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[05de8013-f613-483a-af3e-f87346c3deea]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:07:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1c7aee31-ffa4-41d6-ad43-2b978967cf1e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:31 devstack quobyte-client[83313]: System call of process 88821 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:07:31 devstack quobyte-client[83313]: System call of process 88821 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:07:31 devstack quobyte-client[83313]: System call of process 88821 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:07:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1c7aee31-ffa4-41d6-ad43-2b978967cf1e" returned: 0 in 1.373s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1c7aee31-ffa4-41d6-ad43-2b978967cf1e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1c7aee31-ffa4-41d6-ad43-2b978967cf1e" returned: 0 in 0.377s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:32 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] Lock "cinder-quobyte-1c7aee31-ffa4-41d6-ad43-2b978967cf1e" released by "delete_volume" :: held 2.659s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:07:33 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] Created reservations ['61fb2d4e-a3f0-4169-a083-f6261c185f53', '67f4b199-34d3-4346-82e9-aca970afe820', '4e916d48-7a5b-44c5-b636-8b493e841894', '650f1872-42a4-4d73-8796-dacffd739b23'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:07:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:07:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:07:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:07:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:07:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:07:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.201s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:34 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:07:34 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] Deleted volume successfully. Sep 22 11:07:35 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b07c3a0f-dc9e-44ad-b253-a676354de362 tempest-VolumesTestJSON-1051752300 None] Lock "cinder-1c7aee31-ffa4-41d6-ad43-2b978967cf1e-delete_volume" released by "delete_volume" :: held 5.328s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:07:41 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-08e4b030-169c-451b-b437-27ee13b7eff3 tempest-GroupsTest-828696204 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:07:41 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-08e4b030-169c-451b-b437-27ee13b7eff3 tempest-GroupsTest-828696204 None] Group tempest-Group1-494686677: creating Sep 22 11:07:41 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-08e4b030-169c-451b-b437-27ee13b7eff3 tempest-GroupsTest-828696204 None] Group tempest-Group1-494686677: created successfully Sep 22 11:07:41 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-08e4b030-169c-451b-b437-27ee13b7eff3 tempest-GroupsTest-828696204 None] Create group completed successfully. Sep 22 11:07:42 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-9793d3b8-683d-479d-a44f-e71f97acd512 tempest-GroupsTest-828696204 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:07:42 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-9793d3b8-683d-479d-a44f-e71f97acd512 tempest-GroupsTest-828696204 None] Group tempest-Group2-2109180280: creating Sep 22 11:07:42 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-9793d3b8-683d-479d-a44f-e71f97acd512 tempest-GroupsTest-828696204 None] Group tempest-Group2-2109180280: created successfully Sep 22 11:07:42 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-9793d3b8-683d-479d-a44f-e71f97acd512 tempest-GroupsTest-828696204 None] Create group completed successfully. Sep 22 11:07:44 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Flow 'volume_create_manager' (0cb7e08a-493c-428c-96d7-dffa18d06b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428f2a9e-1444-4f40-b6a5-31b86e0a3ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428f2a9e-1444-4f40-b6a5-31b86e0a3ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1588028032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2fe1fa12-8f39-40be-a2bc-2c197033af42,host='devstack@QuobyteHD#QuobyteHD',id=c32f5712-2311-4351-8ff2-89453dfff582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc8e64a50b3476db1583789315fb6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:07:44Z,use_quota=True,user_id='d147b1529b674afb839c27f1e91b0e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64997faf-cd93-42a3-b739-0c60f96d389f),volume_type_id=64997faf-cd93-42a3-b739-0c60f96d389f)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2497bfc-f251-49c4-b2b3-771a844bcc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2497bfc-f251-49c4-b2b3-771a844bcc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c74c1d-a32c-4d0f-a74e-fd8076382a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c74c1d-a32c-4d0f-a74e-fd8076382a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c32f5712-2311-4351-8ff2-89453dfff582', 'volume_name': 'volume-c32f5712-2311-4351-8ff2-89453dfff582', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (993e9f68-38da-4806-8d6c-7d1316e3b680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (993e9f68-38da-4806-8d6c-7d1316e3b680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ced8137-9732-48ca-8296-a6fda96fcb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:44 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Volume c32f5712-2311-4351-8ff2-89453dfff582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c32f5712-2311-4351-8ff2-89453dfff582', 'volume_size': 1} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2fe1fa12-8f39-40be-a2bc-2c197033af42,created_at=2025-09-22T09:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1588028032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2fe1fa12-8f39-40be-a2bc-2c197033af42,host='devstack@QuobyteHD#QuobyteHD',id=c32f5712-2311-4351-8ff2-89453dfff582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc8e64a50b3476db1583789315fb6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:07:44Z,use_quota=True,user_id='d147b1529b674afb839c27f1e91b0e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64997faf-cd93-42a3-b739-0c60f96d389f),volume_type_id=64997faf-cd93-42a3-b739-0c60f96d389f)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Creating volume c32f5712-2311-4351-8ff2-89453dfff582 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:07:44 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c32f5712-2311-4351-8ff2-89453dfff582 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:44 devstack quobyte-client[83313]: System call of process 88920 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:07:44 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=20, name=volume-c32f5712-2311-4351-8ff2-89453dfff582, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c32f5712-2311-4351-8ff2-89453dfff582 1073741824" returned: 0 in 0.366s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c32f5712-2311-4351-8ff2-89453dfff582 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c32f5712-2311-4351-8ff2-89453dfff582" returned: 0 in 0.172s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] <== create_volume: return (608ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:07:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.617s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:07:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ced8137-9732-48ca-8296-a6fda96fcb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c32f5712-2311-4351-8ff2-89453dfff582', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e847f9-33fd-422a-adef-24ee99c34b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:45 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Volume volume-c32f5712-2311-4351-8ff2-89453dfff582 (c32f5712-2311-4351-8ff2-89453dfff582): created successfully Sep 22 11:07:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e847f9-33fd-422a-adef-24ee99c34b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Flow 'volume_create_manager' (0cb7e08a-493c-428c-96d7-dffa18d06b1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:07:45 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-738da423-1279-4301-afcf-2bdf623bd008 tempest-GroupsTest-828696204 None] Created volume successfully. Sep 22 11:07:46 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:07:46 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] Acquiring lock "cinder-quobyte-c32f5712-2311-4351-8ff2-89453dfff582" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:07:46 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] Lock "cinder-quobyte-c32f5712-2311-4351-8ff2-89453dfff582" acquired by "delete_volume" :: waited 0.024s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:07:46 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef16191-6dc9-40fe-9a6f-1de64b0d83b5]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:07:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c32f5712-2311-4351-8ff2-89453dfff582 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c32f5712-2311-4351-8ff2-89453dfff582" returned: 0 in 0.423s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c32f5712-2311-4351-8ff2-89453dfff582 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c32f5712-2311-4351-8ff2-89453dfff582" returned: 0 in 0.145s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:46 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] Lock "cinder-quobyte-c32f5712-2311-4351-8ff2-89453dfff582" released by "delete_volume" :: held 0.725s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:07:47 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] Created reservations ['c1478372-4089-43a1-9902-5e39c418d3ea'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:07:47 devstack cinder-volume[83310]: WARNING cinder.quota [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-673438045 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-673438045, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:07:47 devstack cinder-volume[83310]: WARNING cinder.quota [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-673438045 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-673438045, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:07:47 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] Created reservations ['d702ee3e-3854-4e44-9f0e-38f5161fde18', 'e87ae173-273f-4f32-b14b-390388cb11c4', 'ad04c42a-01fc-43e7-8c2f-6c859fb120cc', '2b7a32f8-60df-4755-b84f-9ea72a4eca5f'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:07:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:07:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:07:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:07:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:07:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:07:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.111s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:47 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:07:47 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-6d68fe4d-b8c6-4a88-8e7f-3accb391bc73 tempest-GroupsTest-828696204 None] Delete group completed successfully. Sep 22 11:07:49 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-ffa9d6df-7228-4be8-88d2-3174b84cb565 tempest-GroupsTest-828696204 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:07:49 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-ffa9d6df-7228-4be8-88d2-3174b84cb565 tempest-GroupsTest-828696204 None] Created reservations ['17bd49c2-d211-451b-8f0c-ecaaf60e4bd1'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:07:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ffa9d6df-7228-4be8-88d2-3174b84cb565 tempest-GroupsTest-828696204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:07:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ffa9d6df-7228-4be8-88d2-3174b84cb565 tempest-GroupsTest-828696204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:07:50 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ffa9d6df-7228-4be8-88d2-3174b84cb565 tempest-GroupsTest-828696204 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:07:50 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ffa9d6df-7228-4be8-88d2-3174b84cb565 tempest-GroupsTest-828696204 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:07:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ffa9d6df-7228-4be8-88d2-3174b84cb565 tempest-GroupsTest-828696204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:07:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ffa9d6df-7228-4be8-88d2-3174b84cb565 tempest-GroupsTest-828696204 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ffa9d6df-7228-4be8-88d2-3174b84cb565 tempest-GroupsTest-828696204 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.214s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:50 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-ffa9d6df-7228-4be8-88d2-3174b84cb565 tempest-GroupsTest-828696204 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:07:50 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-ffa9d6df-7228-4be8-88d2-3174b84cb565 tempest-GroupsTest-828696204 None] Delete group completed successfully. Sep 22 11:07:52 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-a15c35af-328a-4d83-ac29-bafb1d3b27a4 tempest-GroupsTest-828696204 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:07:52 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-a15c35af-328a-4d83-ac29-bafb1d3b27a4 tempest-GroupsTest-828696204 None] Group tempest-GroupsTest-Group-1289621579: creating Sep 22 11:07:52 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-a15c35af-328a-4d83-ac29-bafb1d3b27a4 tempest-GroupsTest-828696204 None] Group tempest-GroupsTest-Group-1289621579: created successfully Sep 22 11:07:52 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-a15c35af-328a-4d83-ac29-bafb1d3b27a4 tempest-GroupsTest-828696204 None] Create group completed successfully. Sep 22 11:07:54 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Flow 'volume_create_manager' (75f3bca1-d2aa-4508-8b4a-9f9fd1528334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4b21a8-a9c2-495a-82d6-2c2b5b5f3c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4b21a8-a9c2-495a-82d6-2c2b5b5f3c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1501074767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=502fce1a-6988-4e7f-aa53-1d2e27cd8cec,host='devstack@QuobyteHD#QuobyteHD',id=711e91d4-faa7-4b12-9e2b-c1b85c8b8886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc8e64a50b3476db1583789315fb6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:07:54Z,use_quota=True,user_id='d147b1529b674afb839c27f1e91b0e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c34553ac-2960-4a0d-8da2-862aa11468ec),volume_type_id=c34553ac-2960-4a0d-8da2-862aa11468ec)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95e7839-7e26-4a9c-b9f9-30152cac8698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95e7839-7e26-4a9c-b9f9-30152cac8698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eaaa2fa-0e9e-4183-a623-a2299136044e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eaaa2fa-0e9e-4183-a623-a2299136044e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '711e91d4-faa7-4b12-9e2b-c1b85c8b8886', 'volume_name': 'volume-711e91d4-faa7-4b12-9e2b-c1b85c8b8886', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9079525f-ad42-4b5f-9d9e-99fe4b9e2b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9079525f-ad42-4b5f-9d9e-99fe4b9e2b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2b3995-9a7f-4af7-9cb7-691079250b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:54 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Volume 711e91d4-faa7-4b12-9e2b-c1b85c8b8886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-711e91d4-faa7-4b12-9e2b-c1b85c8b8886', 'volume_size': 1} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=502fce1a-6988-4e7f-aa53-1d2e27cd8cec,created_at=2025-09-22T09:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1501074767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=502fce1a-6988-4e7f-aa53-1d2e27cd8cec,host='devstack@QuobyteHD#QuobyteHD',id=711e91d4-faa7-4b12-9e2b-c1b85c8b8886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc8e64a50b3476db1583789315fb6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:07:54Z,use_quota=True,user_id='d147b1529b674afb839c27f1e91b0e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c34553ac-2960-4a0d-8da2-862aa11468ec),volume_type_id=c34553ac-2960-4a0d-8da2-862aa11468ec)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Creating volume 711e91d4-faa7-4b12-9e2b-c1b85c8b8886 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:07:54 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:07:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-711e91d4-faa7-4b12-9e2b-c1b85c8b8886 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:54 devstack quobyte-client[83313]: System call of process 88948 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:07:54 devstack quobyte-client[83313]: System call of process 88948 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:07:54 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=21, name=volume-711e91d4-faa7-4b12-9e2b-c1b85c8b8886, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:07:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-711e91d4-faa7-4b12-9e2b-c1b85c8b8886 1073741824" returned: 0 in 0.496s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-711e91d4-faa7-4b12-9e2b-c1b85c8b8886 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-711e91d4-faa7-4b12-9e2b-c1b85c8b8886" returned: 0 in 0.177s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:55 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] <== create_volume: return (837ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:07:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:07:55 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2b3995-9a7f-4af7-9cb7-691079250b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-711e91d4-faa7-4b12-9e2b-c1b85c8b8886', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:55 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af838f04-c382-4bb4-8789-e12e81dd6ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:55 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Volume volume-711e91d4-faa7-4b12-9e2b-c1b85c8b8886 (711e91d4-faa7-4b12-9e2b-c1b85c8b8886): created successfully Sep 22 11:07:55 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af838f04-c382-4bb4-8789-e12e81dd6ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:55 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Flow 'volume_create_manager' (75f3bca1-d2aa-4508-8b4a-9f9fd1528334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:07:55 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-0bcc5d7b-331e-48fd-8872-db64c45ca39a tempest-GroupsTest-828696204 None] Created volume successfully. Sep 22 11:07:57 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Flow 'volume_create_manager' (6ce2db96-e026-4950-a6e5-5f949a6e4c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e495047-9958-43f4-8261-6e8b5d7d91d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e495047-9958-43f4-8261-6e8b5d7d91d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1787490653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=502fce1a-6988-4e7f-aa53-1d2e27cd8cec,host='devstack@QuobyteHD#QuobyteHD',id=b69bea88-66df-4c76-8c3b-62d47396d8aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc8e64a50b3476db1583789315fb6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:07:57Z,use_quota=True,user_id='d147b1529b674afb839c27f1e91b0e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c34553ac-2960-4a0d-8da2-862aa11468ec),volume_type_id=c34553ac-2960-4a0d-8da2-862aa11468ec)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad478d58-a14f-4034-b0f8-34880d95e816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad478d58-a14f-4034-b0f8-34880d95e816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26710c72-3a18-4c21-ba11-df999101e0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26710c72-3a18-4c21-ba11-df999101e0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b69bea88-66df-4c76-8c3b-62d47396d8aa', 'volume_name': 'volume-b69bea88-66df-4c76-8c3b-62d47396d8aa', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed4a8a9-3989-4e0a-aa40-49c8a80738a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed4a8a9-3989-4e0a-aa40-49c8a80738a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32af0a10-0166-478a-aba0-b60447599c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:57 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Volume b69bea88-66df-4c76-8c3b-62d47396d8aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b69bea88-66df-4c76-8c3b-62d47396d8aa', 'volume_size': 1} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=502fce1a-6988-4e7f-aa53-1d2e27cd8cec,created_at=2025-09-22T09:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1787490653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=502fce1a-6988-4e7f-aa53-1d2e27cd8cec,host='devstack@QuobyteHD#QuobyteHD',id=b69bea88-66df-4c76-8c3b-62d47396d8aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc8e64a50b3476db1583789315fb6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:07:57Z,use_quota=True,user_id='d147b1529b674afb839c27f1e91b0e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c34553ac-2960-4a0d-8da2-862aa11468ec),volume_type_id=c34553ac-2960-4a0d-8da2-862aa11468ec)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Creating volume b69bea88-66df-4c76-8c3b-62d47396d8aa {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:07:57 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:07:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b69bea88-66df-4c76-8c3b-62d47396d8aa 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:57 devstack quobyte-client[83313]: System call of process 88957 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:07:57 devstack quobyte-client[83313]: System call of process 88957 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:07:57 devstack quobyte-client[83313]: System call of process 88957 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:07:57 devstack quobyte-client[83313]: System call of process 88957 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:07:57 devstack quobyte-client[83313]: System call of process 88957 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:07:57 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=22, name=volume-b69bea88-66df-4c76-8c3b-62d47396d8aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:07:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b69bea88-66df-4c76-8c3b-62d47396d8aa 1073741824" returned: 0 in 0.413s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b69bea88-66df-4c76-8c3b-62d47396d8aa {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:07:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b69bea88-66df-4c76-8c3b-62d47396d8aa" returned: 0 in 0.111s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:07:58 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] <== create_volume: return (608ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:07:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.624s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:07:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32af0a10-0166-478a-aba0-b60447599c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b69bea88-66df-4c76-8c3b-62d47396d8aa', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b469973-0b0f-400e-a983-bd2d655e2b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:07:58 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Volume volume-b69bea88-66df-4c76-8c3b-62d47396d8aa (b69bea88-66df-4c76-8c3b-62d47396d8aa): created successfully Sep 22 11:07:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b469973-0b0f-400e-a983-bd2d655e2b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:07:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Flow 'volume_create_manager' (6ce2db96-e026-4950-a6e5-5f949a6e4c30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:07:58 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-b26192ae-3cb1-49d1-ac7f-ac79006b081d tempest-GroupsTest-828696204 None] Created volume successfully. Sep 22 11:08:00 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-fdaea71b-56ee-4d91-8edc-d325854765a2 tempest-GroupsTest-828696204 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:08:00 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-fdaea71b-56ee-4d91-8edc-d325854765a2 tempest-GroupsTest-828696204 None] Update group completed successfully. Sep 22 11:08:01 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-d8315500-1e55-4b97-9df6-8720d2672c12 tempest-GroupsTest-828696204 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:08:01 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-d8315500-1e55-4b97-9df6-8720d2672c12 tempest-GroupsTest-828696204 None] Update group completed successfully. Sep 22 11:08:03 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:08:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Acquiring lock "cinder-quobyte-711e91d4-faa7-4b12-9e2b-c1b85c8b8886" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:08:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Lock "cinder-quobyte-711e91d4-faa7-4b12-9e2b-c1b85c8b8886" acquired by "delete_volume" :: waited 0.023s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:08:03 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc0c1f6-7da9-40b2-a0aa-06be9c6431b8]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:08:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-711e91d4-faa7-4b12-9e2b-c1b85c8b8886 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-711e91d4-faa7-4b12-9e2b-c1b85c8b8886" returned: 0 in 0.531s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-711e91d4-faa7-4b12-9e2b-c1b85c8b8886 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-711e91d4-faa7-4b12-9e2b-c1b85c8b8886" returned: 0 in 0.129s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Lock "cinder-quobyte-711e91d4-faa7-4b12-9e2b-c1b85c8b8886" released by "delete_volume" :: held 0.866s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:08:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Acquiring lock "cinder-quobyte-b69bea88-66df-4c76-8c3b-62d47396d8aa" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:08:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Lock "cinder-quobyte-b69bea88-66df-4c76-8c3b-62d47396d8aa" acquired by "delete_volume" :: waited 0.023s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:08:04 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd878a1-0391-40f9-ab27-d7cb6bf3c0ab]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:08:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b69bea88-66df-4c76-8c3b-62d47396d8aa {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b69bea88-66df-4c76-8c3b-62d47396d8aa" returned: 0 in 0.595s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b69bea88-66df-4c76-8c3b-62d47396d8aa {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b69bea88-66df-4c76-8c3b-62d47396d8aa" returned: 0 in 0.162s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:05 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Lock "cinder-quobyte-b69bea88-66df-4c76-8c3b-62d47396d8aa" released by "delete_volume" :: held 0.931s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:08:05 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Created reservations ['38add84a-27e3-4d7f-89d2-ff195ac57687'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:08:05 devstack cinder-volume[83310]: WARNING cinder.quota [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-636683368 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-636683368, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:08:05 devstack cinder-volume[83310]: WARNING cinder.quota [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-636683368 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-636683368, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:08:05 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Created reservations ['cd718864-8157-4cfa-9c5d-7ad5b762f79f', 'becac802-c957-4fd0-8f53-d5e9337b9bf2', 'd7b68a89-1325-4eee-b297-4c90a6d40714', '065a6e77-7add-477d-85de-323b0d1e66b5'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:08:05 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Created reservations ['600ce225-8aaa-46cc-b9c2-8cea0162bfca', 'c3561da5-bb29-4de7-a3db-665c473d2ce7', 'cc41af35-f7bc-4741-a453-033017d5ca6b', 'f453ae6b-442b-4b79-8b1e-a199fa94031e'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:08:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:08:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:08:06 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:08:06 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:08:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:08:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.123s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:06 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:08:06 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-fc897af8-1294-466e-ba2d-a82fb8714095 tempest-GroupsTest-828696204 None] Delete group completed successfully. Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=59,cinder:UPDATE=80,cinder:DELETE=4,cinder:INSERT=17 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:08:13 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Flow 'volume_create_manager' (98123f27-055c-4dd3-b71c-2f4a98b7f4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c3d24a-a1c5-4b25-94e8-af72c6ebea44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c3d24a-a1c5-4b25-94e8-af72c6ebea44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2120345389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c9e5ef-9100-42db-a0c6-a8ed11a28598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e35c0322394addbb18d83582a85c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:08:13Z,use_quota=True,user_id='24d0cc189006423cb69c38f29cfcee4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d860f7a3-0535-411c-a1a9-6e4a0f204d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d860f7a3-0535-411c-a1a9-6e4a0f204d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f028fb-0bae-47e1-a09d-cadb6d6a92df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f028fb-0bae-47e1-a09d-cadb6d6a92df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8c9e5ef-9100-42db-a0c6-a8ed11a28598', 'volume_name': 'volume-b8c9e5ef-9100-42db-a0c6-a8ed11a28598', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69650e23-4530-45e4-9334-e1061ec39d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69650e23-4530-45e4-9334-e1061ec39d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd53e40-0580-4c0a-b536-090e2ac0ed1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:08:13 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Volume b8c9e5ef-9100-42db-a0c6-a8ed11a28598: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8c9e5ef-9100-42db-a0c6-a8ed11a28598', 'volume_size': 1} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2120345389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c9e5ef-9100-42db-a0c6-a8ed11a28598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e35c0322394addbb18d83582a85c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:08:13Z,use_quota=True,user_id='24d0cc189006423cb69c38f29cfcee4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Creating volume b8c9e5ef-9100-42db-a0c6-a8ed11a28598 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:08:13 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:08:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b8c9e5ef-9100-42db-a0c6-a8ed11a28598 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:14 devstack quobyte-client[83313]: System call of process 89023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:08:14 devstack quobyte-client[83313]: System call of process 89023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:08:14 devstack quobyte-client[83313]: System call of process 89023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:08:14 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=23, name=volume-b8c9e5ef-9100-42db-a0c6-a8ed11a28598, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:08:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b8c9e5ef-9100-42db-a0c6-a8ed11a28598 1073741824" returned: 0 in 0.719s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b8c9e5ef-9100-42db-a0c6-a8ed11a28598 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b8c9e5ef-9100-42db-a0c6-a8ed11a28598" returned: 0 in 0.124s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:14 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] <== create_volume: return (949ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:08:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:08:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd53e40-0580-4c0a-b536-090e2ac0ed1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8c9e5ef-9100-42db-a0c6-a8ed11a28598', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:08:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872fdb20-7613-4421-be97-f0124fd79e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:08:15 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-829034e3-f9cb-4d31-8e17-ddb733af5849 tempest-GroupsV320Test-1067000360 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:08:15 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-829034e3-f9cb-4d31-8e17-ddb733af5849 tempest-GroupsV320Test-1067000360 None] Group tempest-GroupsV320Test-Group-1367842834: creating Sep 22 11:08:15 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Volume volume-b8c9e5ef-9100-42db-a0c6-a8ed11a28598 (b8c9e5ef-9100-42db-a0c6-a8ed11a28598): created successfully Sep 22 11:08:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872fdb20-7613-4421-be97-f0124fd79e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:08:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Flow 'volume_create_manager' (98123f27-055c-4dd3-b71c-2f4a98b7f4a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:08:15 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-829034e3-f9cb-4d31-8e17-ddb733af5849 tempest-GroupsV320Test-1067000360 None] Group tempest-GroupsV320Test-Group-1367842834: created successfully Sep 22 11:08:15 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-829034e3-f9cb-4d31-8e17-ddb733af5849 tempest-GroupsV320Test-1067000360 None] Create group completed successfully. Sep 22 11:08:15 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-bff1bcf9-03de-45ed-a8f2-55c0af48d452 tempest-AttachVolumeTestJSON-1827572322 None] Created volume successfully. Sep 22 11:08:16 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-98ab21ad-4160-4f4c-8599-df7f4e9277b6 tempest-GroupsV320Test-1067000360 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:08:16 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-98ab21ad-4160-4f4c-8599-df7f4e9277b6 tempest-GroupsV320Test-1067000360 None] Created reservations ['8eafab79-c90e-4e96-ade0-ba27bcd1cd21'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:08:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-98ab21ad-4160-4f4c-8599-df7f4e9277b6 tempest-GroupsV320Test-1067000360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:08:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-98ab21ad-4160-4f4c-8599-df7f4e9277b6 tempest-GroupsV320Test-1067000360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:08:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-98ab21ad-4160-4f4c-8599-df7f4e9277b6 tempest-GroupsV320Test-1067000360 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:08:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-98ab21ad-4160-4f4c-8599-df7f4e9277b6 tempest-GroupsV320Test-1067000360 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:08:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-98ab21ad-4160-4f4c-8599-df7f4e9277b6 tempest-GroupsV320Test-1067000360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:08:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98ab21ad-4160-4f4c-8599-df7f4e9277b6 tempest-GroupsV320Test-1067000360 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98ab21ad-4160-4f4c-8599-df7f4e9277b6 tempest-GroupsV320Test-1067000360 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.129s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-98ab21ad-4160-4f4c-8599-df7f4e9277b6 tempest-GroupsV320Test-1067000360 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:08:17 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-98ab21ad-4160-4f4c-8599-df7f4e9277b6 tempest-GroupsV320Test-1067000360 None] Delete group completed successfully. Sep 22 11:08:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:08:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:08:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:08:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:08:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:08:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:08:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.098s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:08:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-bfc115b5-ddcd-4785-b3a1-685386984a81 req-60f31f0a-c59d-40e6-bf98-aa2a21bf5ebe tempest-AttachVolumeTestJSON-1827572322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:08:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-bfc115b5-ddcd-4785-b3a1-685386984a81 req-60f31f0a-c59d-40e6-bf98-aa2a21bf5ebe tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:08:21 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[142154ff-0163-42ae-8cf5-5fb0493aa34c]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:08:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-bfc115b5-ddcd-4785-b3a1-685386984a81 req-60f31f0a-c59d-40e6-bf98-aa2a21bf5ebe tempest-AttachVolumeTestJSON-1827572322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b8c9e5ef-9100-42db-a0c6-a8ed11a28598 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:21 devstack quobyte-client[83313]: System call of process 89052 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:08:21 devstack quobyte-client[83313]: System call of process 89052 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:08:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-bfc115b5-ddcd-4785-b3a1-685386984a81 req-60f31f0a-c59d-40e6-bf98-aa2a21bf5ebe tempest-AttachVolumeTestJSON-1827572322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b8c9e5ef-9100-42db-a0c6-a8ed11a28598" returned: 0 in 0.777s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-bfc115b5-ddcd-4785-b3a1-685386984a81 req-60f31f0a-c59d-40e6-bf98-aa2a21bf5ebe tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.860s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:08:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-bfc115b5-ddcd-4785-b3a1-685386984a81 req-60f31f0a-c59d-40e6-bf98-aa2a21bf5ebe tempest-AttachVolumeTestJSON-1827572322 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-b8c9e5ef-9100-42db-a0c6-a8ed11a28598', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75facf95-8559-42fe-99e9-45eb2e6baa7b', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:08:22 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-bfc115b5-ddcd-4785-b3a1-685386984a81 req-60f31f0a-c59d-40e6-bf98-aa2a21bf5ebe tempest-AttachVolumeTestJSON-1827572322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:08:22 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-bfc115b5-ddcd-4785-b3a1-685386984a81 req-60f31f0a-c59d-40e6-bf98-aa2a21bf5ebe tempest-AttachVolumeTestJSON-1827572322 None] attachment_update completed successfully. Sep 22 11:08:32 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=12,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:08:32 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=57,cinder:INSERT=11,cinder:UPDATE=57,cinder:DELETE=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:08:44 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Flow 'volume_create_manager' (09045ed7-8e50-4aa2-b067-22299349527b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4b1cde-7e8c-449e-9e43-211727394cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4b1cde-7e8c-449e-9e43-211727394cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1289390597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec12c16-8504-46a2-a8be-b46ee5210683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c757945ee484d02b1c4c3f5bcb231f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:08:44Z,use_quota=True,user_id='beff165282ee4ffe8f6a337907b081dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4ea3bd-6e5a-4490-ae4a-6aa8d72c96bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4ea3bd-6e5a-4490-ae4a-6aa8d72c96bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66529b41-a0a3-4438-82fa-bc39dec1baab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66529b41-a0a3-4438-82fa-bc39dec1baab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aec12c16-8504-46a2-a8be-b46ee5210683', 'volume_name': 'volume-aec12c16-8504-46a2-a8be-b46ee5210683', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7608607-3272-4d00-89b7-e2272e08dcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7608607-3272-4d00-89b7-e2272e08dcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a8fe42-acd5-4311-a19d-a66802d8b941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:08:44 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Volume aec12c16-8504-46a2-a8be-b46ee5210683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aec12c16-8504-46a2-a8be-b46ee5210683', 'volume_size': 1} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1289390597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec12c16-8504-46a2-a8be-b46ee5210683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c757945ee484d02b1c4c3f5bcb231f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:08:44Z,use_quota=True,user_id='beff165282ee4ffe8f6a337907b081dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Creating volume aec12c16-8504-46a2-a8be-b46ee5210683 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:08:44 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:08:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-aec12c16-8504-46a2-a8be-b46ee5210683 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:44 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=24, name=volume-aec12c16-8504-46a2-a8be-b46ee5210683, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:08:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-aec12c16-8504-46a2-a8be-b46ee5210683 1073741824" returned: 0 in 0.443s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-aec12c16-8504-46a2-a8be-b46ee5210683 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-aec12c16-8504-46a2-a8be-b46ee5210683" returned: 0 in 0.278s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:45 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] <== create_volume: return (797ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:08:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:08:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a8fe42-acd5-4311-a19d-a66802d8b941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aec12c16-8504-46a2-a8be-b46ee5210683', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:08:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02edd1a5-ddf7-4228-aac5-2f2dee1727cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:08:45 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Volume volume-aec12c16-8504-46a2-a8be-b46ee5210683 (aec12c16-8504-46a2-a8be-b46ee5210683): created successfully Sep 22 11:08:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02edd1a5-ddf7-4228-aac5-2f2dee1727cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:08:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Flow 'volume_create_manager' (09045ed7-8e50-4aa2-b067-22299349527b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:08:46 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-93baf596-4cb4-4663-87f1-411e87066ebb tempest-VolumeQuotasAdminTestJSON-1967306063 None] Created volume successfully. Sep 22 11:08:46 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] Acquiring lock "cinder-aec12c16-8504-46a2-a8be-b46ee5210683-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:08:46 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] Lock "cinder-aec12c16-8504-46a2-a8be-b46ee5210683-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:08:47 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:08:47 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] Acquiring lock "cinder-quobyte-aec12c16-8504-46a2-a8be-b46ee5210683" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:08:47 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] Lock "cinder-quobyte-aec12c16-8504-46a2-a8be-b46ee5210683" acquired by "delete_volume" :: waited 0.011s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:08:47 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9a7ae4-c7ff-4793-8617-88cb3c3b4715]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:08:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-aec12c16-8504-46a2-a8be-b46ee5210683 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:47 devstack quobyte-client[83313]: System call of process 89161 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:08:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-aec12c16-8504-46a2-a8be-b46ee5210683" returned: 0 in 0.487s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-aec12c16-8504-46a2-a8be-b46ee5210683 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-aec12c16-8504-46a2-a8be-b46ee5210683" returned: 0 in 0.115s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:47 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] Lock "cinder-quobyte-aec12c16-8504-46a2-a8be-b46ee5210683" released by "delete_volume" :: held 0.838s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:08:48 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] Created reservations ['4ec23471-4ad6-4b99-993e-4508b83a9616', 'd80cadc7-539e-43e1-881a-3590f56a8569', 'c82dff01-4155-4193-bd5b-2db0d590f51d', 'b9509489-7278-4b1c-884b-a0119eb71889'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:08:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:08:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:08:48 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:08:48 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:08:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:08:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.253s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:48 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:08:49 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] Deleted volume successfully. Sep 22 11:08:49 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c8efd09a-d571-4e16-a7da-945401b8fb06 tempest-VolumeQuotasAdminTestJSON-1967306063 None] Lock "cinder-aec12c16-8504-46a2-a8be-b46ee5210683-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:08:50 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:08:50 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:08:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Flow 'volume_create_manager' (075aa06e-dacd-43c6-951e-537a4e753281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:08:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89384fc-2934-41e1-b65a-97e7e3f949fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89384fc-2934-41e1-b65a-97e7e3f949fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-378631442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afcc1eed-8549-4b13-ba0d-03ef490b1b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c757945ee484d02b1c4c3f5bcb231f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:08:51Z,use_quota=True,user_id='beff165282ee4ffe8f6a337907b081dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9956c979-98d4-45b7-bbc4-242672a27579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9956c979-98d4-45b7-bbc4-242672a27579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c550e4-3678-4511-be21-e4d6c7f1d5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c550e4-3678-4511-be21-e4d6c7f1d5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afcc1eed-8549-4b13-ba0d-03ef490b1b54', 'volume_name': 'volume-afcc1eed-8549-4b13-ba0d-03ef490b1b54', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faec9638-17f9-43cf-a30e-55494f08028b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faec9638-17f9-43cf-a30e-55494f08028b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e003657b-36ef-420f-b888-9d4a9c9831d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:08:51 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Volume afcc1eed-8549-4b13-ba0d-03ef490b1b54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afcc1eed-8549-4b13-ba0d-03ef490b1b54', 'volume_size': 1} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-378631442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afcc1eed-8549-4b13-ba0d-03ef490b1b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c757945ee484d02b1c4c3f5bcb231f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:08:51Z,use_quota=True,user_id='beff165282ee4ffe8f6a337907b081dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Creating volume afcc1eed-8549-4b13-ba0d-03ef490b1b54 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:08:51 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-afcc1eed-8549-4b13-ba0d-03ef490b1b54 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:51 devstack quobyte-client[83313]: System call of process 89222 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:08:51 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=25, name=volume-afcc1eed-8549-4b13-ba0d-03ef490b1b54, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-afcc1eed-8549-4b13-ba0d-03ef490b1b54 1073741824" returned: 0 in 0.483s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-afcc1eed-8549-4b13-ba0d-03ef490b1b54 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-afcc1eed-8549-4b13-ba0d-03ef490b1b54" returned: 0 in 0.191s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] <== create_volume: return (874ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:08:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:08:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e003657b-36ef-420f-b888-9d4a9c9831d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afcc1eed-8549-4b13-ba0d-03ef490b1b54', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:08:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11723111-e23d-45fc-8140-9500d302c418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:08:52 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Volume volume-afcc1eed-8549-4b13-ba0d-03ef490b1b54 (afcc1eed-8549-4b13-ba0d-03ef490b1b54): created successfully Sep 22 11:08:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11723111-e23d-45fc-8140-9500d302c418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:08:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Flow 'volume_create_manager' (075aa06e-dacd-43c6-951e-537a4e753281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:08:52 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-236d15ef-24fb-4f38-9f55-81d80f8407bc tempest-VolumeQuotasAdminTestJSON-1967306063 None] Created volume successfully. Sep 22 11:08:53 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-6af8d3ed-6188-4f02-b426-ac8b24976593 tempest-VolumeQuotasAdminTestJSON-1684398935 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:08:53 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-6af8d3ed-6188-4f02-b426-ac8b24976593 tempest-VolumeQuotasAdminTestJSON-1684398935 None] Transfer volume completed successfully. Sep 22 11:08:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] Acquiring lock "cinder-afcc1eed-8549-4b13-ba0d-03ef490b1b54-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:08:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] Lock "cinder-afcc1eed-8549-4b13-ba0d-03ef490b1b54-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:08:55 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:08:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] Acquiring lock "cinder-quobyte-afcc1eed-8549-4b13-ba0d-03ef490b1b54" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:08:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] Lock "cinder-quobyte-afcc1eed-8549-4b13-ba0d-03ef490b1b54" acquired by "delete_volume" :: waited 0.021s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:08:55 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bc52c3-2ce3-444a-8d2d-bfe8d9b7a0b0]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:08:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-afcc1eed-8549-4b13-ba0d-03ef490b1b54 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-afcc1eed-8549-4b13-ba0d-03ef490b1b54" returned: 0 in 0.474s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-afcc1eed-8549-4b13-ba0d-03ef490b1b54 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-afcc1eed-8549-4b13-ba0d-03ef490b1b54" returned: 0 in 0.102s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] Lock "cinder-quobyte-afcc1eed-8549-4b13-ba0d-03ef490b1b54" released by "delete_volume" :: held 0.800s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:08:56 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] Created reservations ['8626aabf-95ae-4443-895f-4192b0725430', 'b9c1a99c-95a9-4c28-ae59-bf73938aa8d6', 'ac0285c9-b886-4ba8-8f76-8cae1b62b42e', 'dd48b850-6d55-4302-8e55-82fd2fe82318'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:08:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:08:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:08:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:08:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:08:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:08:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:08:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.136s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:08:56 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:08:56 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] Deleted volume successfully. Sep 22 11:08:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f64126dd-8750-46ab-8284-1806d6f7ed70 tempest-VolumeQuotasAdminTestJSON-1750190185 None] Lock "cinder-afcc1eed-8549-4b13-ba0d-03ef490b1b54-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:09:06 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=12,cinder:UPDATE=25,cinder:INSERT=4,cinder:DELETE=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:09:06 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=13,cinder:UPDATE=15,cinder:DELETE=2,cinder:INSERT=4 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:09:07 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-9df8f9bc-d5ab-497b-ac5b-3237bd2792a6 req-a8fbd384-a57f-477b-bdc6-cf2791e67beb tempest-AttachVolumeShelveTestJSON-1546792471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:09:07 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-9df8f9bc-d5ab-497b-ac5b-3237bd2792a6 req-a8fbd384-a57f-477b-bdc6-cf2791e67beb tempest-AttachVolumeShelveTestJSON-1546792471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:09:07 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-9df8f9bc-d5ab-497b-ac5b-3237bd2792a6 req-a8fbd384-a57f-477b-bdc6-cf2791e67beb tempest-AttachVolumeShelveTestJSON-1546792471 None] Terminate volume connection completed successfully. Sep 22 11:09:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-9df8f9bc-d5ab-497b-ac5b-3237bd2792a6 req-a8fbd384-a57f-477b-bdc6-cf2791e67beb tempest-AttachVolumeShelveTestJSON-1546792471 None] Deleting attachment b32c8ae4-a526-448c-93ec-28a53f022483. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:09:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:09:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:09:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:09:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:09:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:09:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:09:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:17 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:09:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.229s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:09:27 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Flow 'volume_create_manager' (4a1509b3-d342-4ce3-b706-5009133afbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb931162-f4aa-4cd1-b699-6ef1443a6741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb931162-f4aa-4cd1-b699-6ef1443a6741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-347149058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d7ced3-e445-462a-8c3d-7b92afde8f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21331cde9d14dea938d8296e3e30ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:09:28Z,use_quota=True,user_id='6bd970fb8efd434b85c07c44af9a2921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e62e02-7899-46c2-bc20-a962cd172da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e62e02-7899-46c2-bc20-a962cd172da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c53f5b-794e-4114-927e-2d723d4aa10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c53f5b-794e-4114-927e-2d723d4aa10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9d7ced3-e445-462a-8c3d-7b92afde8f3d', 'volume_name': 'volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b831e6-5e73-4057-86cf-457227380c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b831e6-5e73-4057-86cf-457227380c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb203530-9d5e-486c-b19c-1a090bcd5471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:09:28 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Volume c9d7ced3-e445-462a-8c3d-7b92afde8f3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d', 'volume_size': 1} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-347149058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d7ced3-e445-462a-8c3d-7b92afde8f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21331cde9d14dea938d8296e3e30ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:09:28Z,use_quota=True,user_id='6bd970fb8efd434b85c07c44af9a2921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Creating volume c9d7ced3-e445-462a-8c3d-7b92afde8f3d {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:09:28 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:28 devstack quobyte-client[83313]: System call of process 89362 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:28 devstack quobyte-client[83313]: System call of process 89362 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:28 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=26, name=volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d 1073741824" returned: 0 in 0.522s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d" returned: 0 in 0.114s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] <== create_volume: return (733ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:09:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:09:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb203530-9d5e-486c-b19c-1a090bcd5471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:09:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0831583b-7a0f-4ab5-a961-4d8dcb8e7ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:09:29 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Volume volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d (c9d7ced3-e445-462a-8c3d-7b92afde8f3d): created successfully Sep 22 11:09:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0831583b-7a0f-4ab5-a961-4d8dcb8e7ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:09:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Flow 'volume_create_manager' (4a1509b3-d342-4ce3-b706-5009133afbdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:09:29 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-890eda97-76d6-4787-9ac4-d1e435d62c9b tempest-VolumesDeleteCascade-116970359 None] Created volume successfully. Sep 22 11:09:30 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:09:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:09:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:09:30 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] Creating offline snapshot dbbda139-46d4-46b0-9fcf-95dc5f351b5c of volume c9d7ced3-e445-462a-8c3d-7b92afde8f3d {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:09:30 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac117d3-bb70-43c8-9e25-645bb3eeba8e]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:09:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d" returned: 0 in 0.515s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:31 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=27, name=volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:09:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c 1G" returned: 0 in 0.237s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:31 devstack quobyte-client[83313]: System call of process 89373 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] CMD "qemu-img rebase -u -b volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c" returned: 0 in 0.154s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:09:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c" returned: 0 in 0.092s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:09:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c" returned: 0 in 0.105s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.info" returned: 0 in 0.136s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:09:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.info" returned: 0 in 0.115s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.771s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:09:32 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-6d71c188-197a-440b-93ef-1ff94ced5d38 tempest-VolumesDeleteCascade-116970359 None] Create snapshot completed successfully Sep 22 11:09:33 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-d642094a-70b1-4efb-a4c6-afa5617c766a tempest-VolumesDeleteCascade-116970359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:09:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d642094a-70b1-4efb-a4c6-afa5617c766a tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:09:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d642094a-70b1-4efb-a4c6-afa5617c766a tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:09:33 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-d642094a-70b1-4efb-a4c6-afa5617c766a tempest-VolumesDeleteCascade-116970359 None] Creating offline snapshot 0e8125aa-7915-4269-b698-80efa43976e6 of volume c9d7ced3-e445-462a-8c3d-7b92afde8f3d {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:09:33 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[5602ea08-0a5f-4a9b-b817-833c1a4eb0fb]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:09:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d642094a-70b1-4efb-a4c6-afa5617c766a tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d642094a-70b1-4efb-a4c6-afa5617c766a tempest-VolumesDeleteCascade-116970359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c" returned: 0 in 0.480s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-d642094a-70b1-4efb-a4c6-afa5617c766a tempest-VolumesDeleteCascade-116970359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:09:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d642094a-70b1-4efb-a4c6-afa5617c766a tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.0e8125aa-7915-4269-b698-80efa43976e6 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:34 devstack quobyte-client[83313]: System call of process 89384 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:34 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=29, name=volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.0e8125aa-7915-4269-b698-80efa43976e6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:09:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d642094a-70b1-4efb-a4c6-afa5617c766a tempest-VolumesDeleteCascade-116970359 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.0e8125aa-7915-4269-b698-80efa43976e6 1G" returned: 0 in 0.380s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d642094a-70b1-4efb-a4c6-afa5617c766a tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.0e8125aa-7915-4269-b698-80efa43976e6 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:34 devstack quobyte-client[83313]: System call of process 89387 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d642094a-70b1-4efb-a4c6-afa5617c766a tempest-VolumesDeleteCascade-116970359 None] CMD "qemu-img rebase -u -b volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.0e8125aa-7915-4269-b698-80efa43976e6" returned: 0 in 0.225s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-d642094a-70b1-4efb-a4c6-afa5617c766a tempest-VolumesDeleteCascade-116970359 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.0e8125aa-7915-4269-b698-80efa43976e6 is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:09:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d642094a-70b1-4efb-a4c6-afa5617c766a tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.0e8125aa-7915-4269-b698-80efa43976e6 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d642094a-70b1-4efb-a4c6-afa5617c766a tempest-VolumesDeleteCascade-116970359 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.0e8125aa-7915-4269-b698-80efa43976e6" returned: 0 in 0.134s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-d642094a-70b1-4efb-a4c6-afa5617c766a tempest-VolumesDeleteCascade-116970359 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:09:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d642094a-70b1-4efb-a4c6-afa5617c766a tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.0e8125aa-7915-4269-b698-80efa43976e6 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d642094a-70b1-4efb-a4c6-afa5617c766a tempest-VolumesDeleteCascade-116970359 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.0e8125aa-7915-4269-b698-80efa43976e6" returned: 0 in 0.124s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d642094a-70b1-4efb-a4c6-afa5617c766a tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.661s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:09:35 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-d642094a-70b1-4efb-a4c6-afa5617c766a tempest-VolumesDeleteCascade-116970359 None] Create snapshot completed successfully Sep 22 11:09:35 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "cinder-c9d7ced3-e445-462a-8c3d-7b92afde8f3d-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:09:36 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-c9d7ced3-e445-462a-8c3d-7b92afde8f3d-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:09:36 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:09:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Performing cascade delete. {{(pid=83310) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 22 11:09:36 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "cinder-0e8125aa-7915-4269-b698-80efa43976e6-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:09:36 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-0e8125aa-7915-4269-b698-80efa43976e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:09:36 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:09:36 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "cinder-quobyte-c9d7ced3-e445-462a-8c3d-7b92afde8f3d" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:09:36 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-c9d7ced3-e445-462a-8c3d-7b92afde8f3d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:09:36 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "cinder-quobyte-0e8125aa-7915-4269-b698-80efa43976e6" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:09:36 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-0e8125aa-7915-4269-b698-80efa43976e6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:09:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Deleting offline snapshot 0e8125aa-7915-4269-b698-80efa43976e6 of volume c9d7ced3-e445-462a-8c3d-7b92afde8f3d {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:09:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] snapshot_file for this snap is: volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.0e8125aa-7915-4269-b698-80efa43976e6 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:09:36 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[def845a3-8400-4f07-9526-e9a81f7d6c22]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:09:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.0e8125aa-7915-4269-b698-80efa43976e6 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:37 devstack quobyte-client[83313]: System call of process 89393 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.0e8125aa-7915-4269-b698-80efa43976e6" returned: 0 in 1.259s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:09:37 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c597bc1-2dea-4a3f-a800-852e7ac35680]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:09:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:38 devstack quobyte-client[83313]: System call of process 89400 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:38 devstack quobyte-client[83313]: System call of process 89400 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:39 devstack quobyte-client[83313]: System call of process 89400 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:39 devstack quobyte-client[83313]: System call of process 89400 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c" returned: 0 in 1.222s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:09:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.0e8125aa-7915-4269-b698-80efa43976e6 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:39 devstack quobyte-client[83313]: System call of process 89406 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:39 devstack quobyte-client[83313]: System call of process 89406 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:39 devstack quobyte-client[83313]: System call of process 89406 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.0e8125aa-7915-4269-b698-80efa43976e6" returned: 0 in 0.893s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.0e8125aa-7915-4269-b698-80efa43976e6 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.0e8125aa-7915-4269-b698-80efa43976e6" returned: 0 in 0.442s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:40 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-0e8125aa-7915-4269-b698-80efa43976e6" released by "_delete_snapshot" :: held 4.573s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:09:40 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-c9d7ced3-e445-462a-8c3d-7b92afde8f3d" released by "delete_snapshot" :: held 4.611s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:09:41 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Created reservations ['178b222f-aab6-4819-9409-34ef1c81e401', 'ff939969-4f93-415e-9532-6e674ff4c10f', '792c0c33-5928-4ce9-9c08-97889b668d5c', 'a8b52c91-389e-425a-aeb9-4a7b2e4fca87'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:09:41 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Delete snapshot completed successfully. Sep 22 11:09:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-0e8125aa-7915-4269-b698-80efa43976e6-delete_snapshot" released by "delete_snapshot" :: held 5.308s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:09:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "cinder-dbbda139-46d4-46b0-9fcf-95dc5f351b5c-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:09:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-dbbda139-46d4-46b0-9fcf-95dc5f351b5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:09:41 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:09:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "cinder-quobyte-c9d7ced3-e445-462a-8c3d-7b92afde8f3d" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:09:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-c9d7ced3-e445-462a-8c3d-7b92afde8f3d" acquired by "delete_snapshot" :: waited 0.035s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:09:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "cinder-quobyte-dbbda139-46d4-46b0-9fcf-95dc5f351b5c" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:09:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-dbbda139-46d4-46b0-9fcf-95dc5f351b5c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:09:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Deleting offline snapshot dbbda139-46d4-46b0-9fcf-95dc5f351b5c of volume c9d7ced3-e445-462a-8c3d-7b92afde8f3d {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:09:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] snapshot_file for this snap is: volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:09:41 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6ce324-036b-4be2-af65-6767bbfe8581]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:09:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:42 devstack quobyte-client[83313]: System call of process 89419 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c" returned: 0 in 0.811s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:42 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:09:42 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad10381a-ac6e-4dab-b30a-96c87f18789c]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:09:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d" returned: 0 in 0.640s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c" returned: 0 in 0.259s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d.dbbda139-46d4-46b0-9fcf-95dc5f351b5c" returned: 0 in 0.109s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-dbbda139-46d4-46b0-9fcf-95dc5f351b5c" released by "_delete_snapshot" :: held 2.293s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:09:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-c9d7ced3-e445-462a-8c3d-7b92afde8f3d" released by "delete_snapshot" :: held 2.325s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:09:44 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Created reservations ['3dec7ad8-e9f4-47ea-8721-6e47dbad07ec', '0563c2bf-dd87-4283-919a-b6bf87801179', '75b4315e-7769-4366-b631-c5c3813809aa', 'cf9b10fb-9b27-481d-aecf-da7fc3b38794'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:09:44 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Delete snapshot completed successfully. Sep 22 11:09:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-dbbda139-46d4-46b0-9fcf-95dc5f351b5c-delete_snapshot" released by "delete_snapshot" :: held 3.001s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:09:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Snapshots deleted, issuing volume delete {{(pid=83310) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 22 11:09:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "cinder-quobyte-c9d7ced3-e445-462a-8c3d-7b92afde8f3d" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:09:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-c9d7ced3-e445-462a-8c3d-7b92afde8f3d" acquired by "delete_volume" :: waited 0.046s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:09:44 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[61423fad-0997-47e8-8ad9-782ee74be947]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:09:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:45 devstack quobyte-client[83313]: System call of process 89440 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d" returned: 0 in 0.435s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c9d7ced3-e445-462a-8c3d-7b92afde8f3d" returned: 0 in 0.173s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-c9d7ced3-e445-462a-8c3d-7b92afde8f3d" released by "delete_volume" :: held 0.945s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:09:46 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Created reservations ['5e767947-6b4a-4dd6-b1bf-28cadaf4b516', 'e5838c79-4245-4f9c-b7ef-7a3f324ac626', '6c1fd654-d1be-4424-8d65-640bcc7a8e66', '6014c0a6-e6b8-4e93-81c9-f5bd80289b06'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:09:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:09:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:09:46 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:09:46 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:09:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:09:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.174s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:46 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:09:46 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Deleted volume successfully. Sep 22 11:09:46 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b89085a-63f5-46ec-be4c-9c6e2fe9c615 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-c9d7ced3-e445-462a-8c3d-7b92afde8f3d-delete_volume" released by "delete_volume" :: held 10.801s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:09:47 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Flow 'volume_create_manager' (add466d0-9ab2-4625-8725-ffff4a06ec93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0acc6389-05bc-4fee-81da-ccacdf58c975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0acc6389-05bc-4fee-81da-ccacdf58c975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-180681825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21331cde9d14dea938d8296e3e30ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:09:47Z,use_quota=True,user_id='6bd970fb8efd434b85c07c44af9a2921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253b9de1-0f08-4de3-97e7-7f334626c1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253b9de1-0f08-4de3-97e7-7f334626c1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f9db5b-dea0-47cf-b39e-91786b1ea71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f9db5b-dea0-47cf-b39e-91786b1ea71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4', 'volume_name': 'volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0d4942-7ff8-4326-a0e2-3ff49a99370d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0d4942-7ff8-4326-a0e2-3ff49a99370d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee4f3cd-fb1c-41c5-8179-c6eab7decf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:09:47 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Volume 828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4', 'volume_size': 1} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-180681825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21331cde9d14dea938d8296e3e30ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:09:47Z,use_quota=True,user_id='6bd970fb8efd434b85c07c44af9a2921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Creating volume 828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:09:47 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:09:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:47 devstack quobyte-client[83313]: System call of process 89455 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:47 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=30, name=volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:09:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 1073741824" returned: 0 in 0.424s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4" returned: 0 in 0.213s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:48 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] <== create_volume: return (729ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:09:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:09:48 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee4f3cd-fb1c-41c5-8179-c6eab7decf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:09:48 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2bd961-96e1-4f76-a7ea-376f3496394e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:09:48 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Volume volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 (828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4): created successfully Sep 22 11:09:48 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2bd961-96e1-4f76-a7ea-376f3496394e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:09:48 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Flow 'volume_create_manager' (add466d0-9ab2-4625-8725-ffff4a06ec93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:09:48 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-ec9fdd77-b9fe-4c21-b95d-769ed352bb38 tempest-VolumesDeleteCascade-116970359 None] Created volume successfully. Sep 22 11:09:49 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:09:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:09:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:09:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] Creating offline snapshot 52e83e56-4543-4f4f-ba62-7b19289a2f40 of volume 828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:09:50 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1df3e9-eda6-407d-87d6-7405b34119d7]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:09:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:51 devstack quobyte-client[83313]: System call of process 89469 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:51 devstack quobyte-client[83313]: System call of process 89469 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:51 devstack quobyte-client[83313]: System call of process 89469 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4" returned: 0 in 1.909s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.52e83e56-4543-4f4f-ba62-7b19289a2f40 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:52 devstack quobyte-client[83313]: System call of process 89501 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:53 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=31, name=volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.52e83e56-4543-4f4f-ba62-7b19289a2f40, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:09:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.52e83e56-4543-4f4f-ba62-7b19289a2f40 1G" returned: 0 in 1.329s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): qemu-img rebase -u -b volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.52e83e56-4543-4f4f-ba62-7b19289a2f40 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:54 devstack quobyte-client[83313]: System call of process 89531 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:54 devstack quobyte-client[83313]: System call of process 89531 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:54 devstack quobyte-client[83313]: System call of process 89531 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:54 devstack quobyte-client[83313]: System call of process 89531 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:09:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] CMD "qemu-img rebase -u -b volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.52e83e56-4543-4f4f-ba62-7b19289a2f40" returned: 0 in 0.659s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.52e83e56-4543-4f4f-ba62-7b19289a2f40 is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:09:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.52e83e56-4543-4f4f-ba62-7b19289a2f40 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.52e83e56-4543-4f4f-ba62-7b19289a2f40" returned: 0 in 0.249s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:09:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.52e83e56-4543-4f4f-ba62-7b19289a2f40 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.52e83e56-4543-4f4f-ba62-7b19289a2f40" returned: 0 in 0.539s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.info" returned: 0 in 0.330s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:09:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:09:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.info" returned: 0 in 0.267s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:09:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.608s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:09:57 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-5d5e8663-2c36-4263-b80a-47af529f5bc7 tempest-VolumesDeleteCascade-116970359 None] Create snapshot completed successfully Sep 22 11:09:59 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Flow 'volume_create_manager' (0c9cf683-c835-438a-862e-034508f812a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2d91f7-fd04-41c2-b411-604ad9c6d47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2d91f7-fd04-41c2-b411-604ad9c6d47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1735273694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9ffe9d-2838-4725-b55a-ab31ec00fd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21331cde9d14dea938d8296e3e30ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=52e83e56-4543-4f4f-ba62-7b19289a2f40,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:09:59Z,use_quota=True,user_id='6bd970fb8efd434b85c07c44af9a2921',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1961d9-a23c-42d6-905e-931e86aeeb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1961d9-a23c-42d6-905e-931e86aeeb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4755ce7d-729a-4ab3-9bf8-438ae69b1cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4755ce7d-729a-4ab3-9bf8-438ae69b1cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0b9ffe9d-2838-4725-b55a-ab31ec00fd2c', 'volume_name': 'volume-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c', 'volume_size': 1, 'snapshot_id': '52e83e56-4543-4f4f-ba62-7b19289a2f40'}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5b8eea-4e29-433f-84f8-3b2221996ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5b8eea-4e29-433f-84f8-3b2221996ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbbf439e-41f8-429c-8cfb-6660ee78e116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:09:59 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Volume 0b9ffe9d-2838-4725-b55a-ab31ec00fd2c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c', 'volume_size': 1, 'snapshot_id': '52e83e56-4543-4f4f-ba62-7b19289a2f40'} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "cinder-quobyte-52e83e56-4543-4f4f-ba62-7b19289a2f40-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c" by "_create_volume_from_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-52e83e56-4543-4f4f-ba62-7b19289a2f40-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Creating volume 0b9ffe9d-2838-4725-b55a-ab31ec00fd2c from snapshot 52e83e56-4543-4f4f-ba62-7b19289a2f40 {{(pid=83310) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "cinder-quobyte-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c" by "_copy_volume_from_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] snapshot: 52e83e56-4543-4f4f-ba62-7b19289a2f40, volume: 0b9ffe9d-2838-4725-b55a-ab31ec00fd2c, {{(pid=83310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[15223b70-2f84-4dbd-a478-ff5f39eede81]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:09:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.52e83e56-4543-4f4f-ba62-7b19289a2f40 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:00 devstack quobyte-client[83313]: System call of process 89555 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:10:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.52e83e56-4543-4f4f-ba62-7b19289a2f40" returned: 0 in 0.469s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:00 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:10:00 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 {{(pid=83310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 22 11:10:00 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Creating direct copy from snapshot {{(pid=83310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 22 11:10:00 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b39b59-fe66-4cb2-a8a1-9fb0d80da393]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:10:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:00 devstack quobyte-client[83313]: System call of process 89559 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:10:00 devstack quobyte-client[83313]: System call of process 89559 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:10:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4" returned: 0 in 0.615s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:01 devstack cinder-volume[83310]: DEBUG cinder.utils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c not found in is_blk_device check {{(pid=83310) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 22 11:10:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:01 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=33, name=volume-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:10:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c" returned: 0 in 7.878s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:09 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c0c220-4cec-461d-bd1f-2eab8610cc8b]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:10:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:09 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=34,cinder:SELECT=30,cinder:DELETE=1,cinder:INSERT=8 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:10:09 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=19,cinder:UPDATE=20,cinder:DELETE=5,cinder:INSERT=4 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:10:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4" returned: 0 in 1.278s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:10 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Image conversion details: src /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4, size 1024.00 MB, duration 7.95 sec, destination /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c {{(pid=83310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 22 11:10:10 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Converted 1024.00 MB image at 128.80 MB/s Sep 22 11:10:10 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:10:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c" returned: 0 in 0.212s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:10 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c" released by "_copy_volume_from_snapshot" :: held 11.033s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:10:10 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-52e83e56-4543-4f4f-ba62-7b19289a2f40-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c" released by "_create_volume_from_snapshot" :: held 11.094s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:10:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.125s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:10:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbbf439e-41f8-429c-8cfb-6660ee78e116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c', 'volume_size': 1, 'snapshot_id': '52e83e56-4543-4f4f-ba62-7b19289a2f40'}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e6ffcc-2d7a-451b-bec2-f12a0ceba6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:11 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Volume volume-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c (0b9ffe9d-2838-4725-b55a-ab31ec00fd2c): created successfully Sep 22 11:10:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e6ffcc-2d7a-451b-bec2-f12a0ceba6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Flow 'volume_create_manager' (0c9cf683-c835-438a-862e-034508f812a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:10:11 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-bc03f1e5-289b-477e-811d-d1eb18555b9d tempest-VolumesDeleteCascade-116970359 None] Created volume successfully. Sep 22 11:10:11 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "cinder-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:10:11 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:10:12 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:10:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Performing cascade delete. {{(pid=83310) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 22 11:10:12 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "cinder-52e83e56-4543-4f4f-ba62-7b19289a2f40-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:10:12 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-52e83e56-4543-4f4f-ba62-7b19289a2f40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:10:12 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:10:12 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "cinder-quobyte-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:10:12 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:10:12 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "cinder-quobyte-52e83e56-4543-4f4f-ba62-7b19289a2f40" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:10:12 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-52e83e56-4543-4f4f-ba62-7b19289a2f40" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:10:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Deleting offline snapshot 52e83e56-4543-4f4f-ba62-7b19289a2f40 of volume 828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:10:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] snapshot_file for this snap is: volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.52e83e56-4543-4f4f-ba62-7b19289a2f40 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:10:12 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1780805-b0b1-49e6-beb0-5d398cd7c172]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:10:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.52e83e56-4543-4f4f-ba62-7b19289a2f40 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:13 devstack quobyte-client[83313]: System call of process 89600 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:10:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.52e83e56-4543-4f4f-ba62-7b19289a2f40" returned: 0 in 0.601s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:13 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:10:13 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb881ec1-124e-41a8-8764-5d22bc2fe1b2]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:10:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:13 devstack quobyte-client[83313]: System call of process 89603 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:10:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4" returned: 0 in 0.537s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.52e83e56-4543-4f4f-ba62-7b19289a2f40 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:14 devstack quobyte-client[83313]: System call of process 89636 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:10:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.52e83e56-4543-4f4f-ba62-7b19289a2f40" returned: 0 in 0.440s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.52e83e56-4543-4f4f-ba62-7b19289a2f40 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4.52e83e56-4543-4f4f-ba62-7b19289a2f40" returned: 0 in 0.205s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:14 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-52e83e56-4543-4f4f-ba62-7b19289a2f40" released by "_delete_snapshot" :: held 2.346s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:10:14 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4" released by "delete_snapshot" :: held 2.388s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:10:15 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Created reservations ['84cde5fb-6086-40ea-af07-f490f24e2cce', '3af8a860-b101-4a5b-8804-0bfa21d97868', '6ed43dd1-78de-4c39-9ceb-72b23f7b3ee4', '5b3d64c1-ae9e-43d0-ac99-a645f0f3edc1'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:10:15 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Delete snapshot completed successfully. Sep 22 11:10:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-52e83e56-4543-4f4f-ba62-7b19289a2f40-delete_snapshot" released by "delete_snapshot" :: held 2.972s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:10:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Snapshots deleted, issuing volume delete {{(pid=83310) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 22 11:10:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "cinder-quobyte-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:10:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4" acquired by "delete_volume" :: waited 0.016s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:10:15 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54ab88d-1e17-41b9-a68c-e9a569c12331]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:10:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:16 devstack quobyte-client[83313]: System call of process 89642 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:10:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4" returned: 0 in 0.555s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4" returned: 0 in 0.159s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:16 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4" released by "delete_volume" :: held 0.877s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:10:16 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Created reservations ['db628ef7-783c-4725-a078-25afff861cc2', '67b21750-3b05-4b94-ab1e-04fce0195dfb', 'b03c09a2-d149-47f2-8206-610723a0fcc0', '51df5a93-8bb7-4f11-968e-f06436813276'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:10:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:10:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:10:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:10:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:10:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:10:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.109s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:16 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:10:17 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Deleted volume successfully. Sep 22 11:10:17 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5fc799a-264a-4b28-93d1-d9c1f7c29b95 tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-828eb6d0-fd6e-4a8e-9dff-2afc4b74c1c4-delete_volume" released by "delete_volume" :: held 5.393s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:10:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:10:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:10:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:10:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:10:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:10:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:10:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.172s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:10:17 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "cinder-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:10:17 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:10:18 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:10:18 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "cinder-quobyte-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:10:18 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c" acquired by "delete_volume" :: waited 0.012s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:10:18 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ca986b-5924-4931-b0e4-9381870caf59]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:10:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:18 devstack quobyte-client[83313]: System call of process 89648 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:10:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c" returned: 0 in 0.493s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c" returned: 0 in 0.120s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:18 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-quobyte-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c" released by "delete_volume" :: held 0.788s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:10:19 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] Created reservations ['22312eca-cf81-47a7-bc57-a416a73ab47d', '7442d3f6-a4a4-4cb3-b60b-ddc7c7991a68', '2a81fa73-5fab-425d-8aa4-fa26fac69983', '3c469d5c-4679-4412-bf4b-7612e80ba658'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:10:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:10:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:10:19 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:10:19 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:10:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:10:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.114s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:19 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:10:19 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] Deleted volume successfully. Sep 22 11:10:19 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e09a14ce-608a-43c2-9286-4411e939961b tempest-VolumesDeleteCascade-116970359 None] Lock "cinder-0b9ffe9d-2838-4725-b55a-ab31ec00fd2c-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:10:25 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-9151fd0f-2c99-4e43-b3f5-382a535a5c3f req-6f28502d-5266-48a2-83fd-fecf59d5e1af tempest-AttachVolumeTestJSON-1827572322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:10:25 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-9151fd0f-2c99-4e43-b3f5-382a535a5c3f req-6f28502d-5266-48a2-83fd-fecf59d5e1af tempest-AttachVolumeTestJSON-1827572322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:10:25 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-9151fd0f-2c99-4e43-b3f5-382a535a5c3f req-6f28502d-5266-48a2-83fd-fecf59d5e1af tempest-AttachVolumeTestJSON-1827572322 None] Terminate volume connection completed successfully. Sep 22 11:10:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-9151fd0f-2c99-4e43-b3f5-382a535a5c3f req-6f28502d-5266-48a2-83fd-fecf59d5e1af tempest-AttachVolumeTestJSON-1827572322 None] Deleting attachment 75facf95-8559-42fe-99e9-45eb2e6baa7b. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:10:27 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:10:27 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:10:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Flow 'volume_create_manager' (df90ef2f-6bf1-43b0-89db-4537996d2651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:10:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b676a4-17f8-4ce0-aaf1-26289eccf721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b676a4-17f8-4ce0-aaf1-26289eccf721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1106329439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23adec82-70d9-4980-8333-ead6a89d8224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4362440e49f84254a9408cfaa34dde65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:10:28Z,use_quota=True,user_id='c32396744b6f40b4b074c5ebb31f5938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54de9b2-c1dd-48f1-833c-dd905c20a013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54de9b2-c1dd-48f1-833c-dd905c20a013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe526ba-2acf-42b6-b7be-a5d2816c4d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe526ba-2acf-42b6-b7be-a5d2816c4d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23adec82-70d9-4980-8333-ead6a89d8224', 'volume_name': 'volume-23adec82-70d9-4980-8333-ead6a89d8224', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f655bc98-0369-479a-95f6-ed301f54f833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f655bc98-0369-479a-95f6-ed301f54f833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e51464-4297-4c1a-bebf-3dbb554ddafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:27 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Volume 23adec82-70d9-4980-8333-ead6a89d8224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23adec82-70d9-4980-8333-ead6a89d8224', 'volume_size': 1} Sep 22 11:10:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:10:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:10:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1106329439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23adec82-70d9-4980-8333-ead6a89d8224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4362440e49f84254a9408cfaa34dde65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:10:28Z,use_quota=True,user_id='c32396744b6f40b4b074c5ebb31f5938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:10:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Creating volume 23adec82-70d9-4980-8333-ead6a89d8224 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:10:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:10:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:10:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:10:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:10:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:10:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:10:28 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:10:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-23adec82-70d9-4980-8333-ead6a89d8224 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:28 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=34, name=volume-23adec82-70d9-4980-8333-ead6a89d8224, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:10:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-23adec82-70d9-4980-8333-ead6a89d8224 1073741824" returned: 0 in 0.428s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-23adec82-70d9-4980-8333-ead6a89d8224 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-23adec82-70d9-4980-8333-ead6a89d8224" returned: 0 in 0.767s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] <== create_volume: return (1532ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:10:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:10:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e51464-4297-4c1a-bebf-3dbb554ddafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23adec82-70d9-4980-8333-ead6a89d8224', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b920360-1a67-4703-9214-e1b569ea62bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:30 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Volume volume-23adec82-70d9-4980-8333-ead6a89d8224 (23adec82-70d9-4980-8333-ead6a89d8224): created successfully Sep 22 11:10:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b920360-1a67-4703-9214-e1b569ea62bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Flow 'volume_create_manager' (df90ef2f-6bf1-43b0-89db-4537996d2651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:10:30 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-20b82a5f-0aa1-41ec-bde1-f3871b9fb32d tempest-VolumesTransfersTest-355343899 None] Created volume successfully. Sep 22 11:10:32 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-ed44059f-cc0c-4006-b2bf-b646a38f428f tempest-VolumesTransfersTest-247813222 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:10:32 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-ed44059f-cc0c-4006-b2bf-b646a38f428f tempest-VolumesTransfersTest-247813222 None] Transfer volume completed successfully. Sep 22 11:10:33 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] Acquiring lock "cinder-23adec82-70d9-4980-8333-ead6a89d8224-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:10:33 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] Lock "cinder-23adec82-70d9-4980-8333-ead6a89d8224-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:10:33 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:10:33 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] Acquiring lock "cinder-quobyte-23adec82-70d9-4980-8333-ead6a89d8224" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:10:33 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] Lock "cinder-quobyte-23adec82-70d9-4980-8333-ead6a89d8224" acquired by "delete_volume" :: waited 0.016s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:10:33 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8088f26b-5d40-4b2a-abd3-12ead15c3fdb]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:10:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-23adec82-70d9-4980-8333-ead6a89d8224 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:34 devstack quobyte-client[83313]: System call of process 89766 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:10:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-23adec82-70d9-4980-8333-ead6a89d8224" returned: 0 in 0.700s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-23adec82-70d9-4980-8333-ead6a89d8224 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-23adec82-70d9-4980-8333-ead6a89d8224" returned: 0 in 0.130s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] Lock "cinder-quobyte-23adec82-70d9-4980-8333-ead6a89d8224" released by "delete_volume" :: held 1.149s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:10:35 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] Created reservations ['7145e449-26ea-4b04-b23f-bce85895970c', '9c675fff-8301-4c1e-8541-dc2efd0057be', 'c95276b5-78e0-4cc6-b652-1939ad7852ef', '9bbfff1b-8060-449f-b6f6-e43cd8901531'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:10:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:10:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:10:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:10:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:10:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:10:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.112s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:35 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:10:35 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] Deleted volume successfully. Sep 22 11:10:35 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9b392457-39a4-4fa9-b0f3-796733bae240 tempest-VolumesTransfersTest-1417544922 None] Lock "cinder-23adec82-70d9-4980-8333-ead6a89d8224-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:10:36 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Flow 'volume_create_manager' (c55ce1ff-2e50-4303-a389-e2cdeba5ff55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc67be52-798a-4a2a-a371-7c66666e2a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc67be52-798a-4a2a-a371-7c66666e2a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-149910785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=991c7260-ad82-45ea-b1fc-a8c24e811015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4362440e49f84254a9408cfaa34dde65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:10:36Z,use_quota=True,user_id='c32396744b6f40b4b074c5ebb31f5938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9553be2-6df5-4a04-bbc8-b4715192c704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9553be2-6df5-4a04-bbc8-b4715192c704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35930e4a-9d60-4c21-a832-af33dbd5f2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35930e4a-9d60-4c21-a832-af33dbd5f2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '991c7260-ad82-45ea-b1fc-a8c24e811015', 'volume_name': 'volume-991c7260-ad82-45ea-b1fc-a8c24e811015', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82585e8-d54b-40ff-9aa9-7f9c221b21f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82585e8-d54b-40ff-9aa9-7f9c221b21f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8bf0d0-880c-47b7-8be7-4b4009bc5aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:36 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Volume 991c7260-ad82-45ea-b1fc-a8c24e811015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-991c7260-ad82-45ea-b1fc-a8c24e811015', 'volume_size': 1} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-149910785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=991c7260-ad82-45ea-b1fc-a8c24e811015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4362440e49f84254a9408cfaa34dde65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:10:36Z,use_quota=True,user_id='c32396744b6f40b4b074c5ebb31f5938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Creating volume 991c7260-ad82-45ea-b1fc-a8c24e811015 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:10:36 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:10:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-991c7260-ad82-45ea-b1fc-a8c24e811015 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:37 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=35, name=volume-991c7260-ad82-45ea-b1fc-a8c24e811015, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:10:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-991c7260-ad82-45ea-b1fc-a8c24e811015 1073741824" returned: 0 in 0.516s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-991c7260-ad82-45ea-b1fc-a8c24e811015 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-991c7260-ad82-45ea-b1fc-a8c24e811015" returned: 0 in 0.143s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] <== create_volume: return (735ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:10:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:10:37 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8bf0d0-880c-47b7-8be7-4b4009bc5aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-991c7260-ad82-45ea-b1fc-a8c24e811015', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:37 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c1a3af-cb49-486f-85cd-4c9b3f575603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:37 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Volume volume-991c7260-ad82-45ea-b1fc-a8c24e811015 (991c7260-ad82-45ea-b1fc-a8c24e811015): created successfully Sep 22 11:10:37 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c1a3af-cb49-486f-85cd-4c9b3f575603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:37 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Flow 'volume_create_manager' (c55ce1ff-2e50-4303-a389-e2cdeba5ff55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:10:37 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-534b0672-d975-4761-a8c5-ac4f8796bac6 tempest-VolumesTransfersTest-355343899 None] Created volume successfully. Sep 22 11:10:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] Acquiring lock "cinder-991c7260-ad82-45ea-b1fc-a8c24e811015-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:10:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] Lock "cinder-991c7260-ad82-45ea-b1fc-a8c24e811015-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:10:39 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:10:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] Acquiring lock "cinder-quobyte-991c7260-ad82-45ea-b1fc-a8c24e811015" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:10:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] Lock "cinder-quobyte-991c7260-ad82-45ea-b1fc-a8c24e811015" acquired by "delete_volume" :: waited 0.015s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:10:39 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aeed64f-b0f7-49fb-8399-aa415e333e53]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:10:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-991c7260-ad82-45ea-b1fc-a8c24e811015 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-991c7260-ad82-45ea-b1fc-a8c24e811015" returned: 0 in 0.508s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-991c7260-ad82-45ea-b1fc-a8c24e811015 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-991c7260-ad82-45ea-b1fc-a8c24e811015" returned: 0 in 0.167s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:40 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] Lock "cinder-quobyte-991c7260-ad82-45ea-b1fc-a8c24e811015" released by "delete_volume" :: held 0.962s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:10:40 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] Created reservations ['75215df1-89a4-4188-8116-794e498068a3', 'e8003fc7-4f82-4b7e-b264-6d709eee0029', '6eec5d8f-8052-4088-a3f6-ab74eac2804a', '4a5ca81d-1fd2-43f6-af27-307b194eb754'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:10:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:10:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:10:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:10:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:10:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:10:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.202s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:41 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:10:41 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] Deleted volume successfully. Sep 22 11:10:42 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d7830bf1-21ec-465f-a8c5-809e87082c04 tempest-VolumesTransfersTest-1417544922 None] Lock "cinder-991c7260-ad82-45ea-b1fc-a8c24e811015-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:10:50 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=38,cinder:DELETE=4,cinder:SELECT=25,cinder:INSERT=9 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:10:51 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=34,cinder:UPDATE=48,cinder:INSERT=11,cinder:DELETE=3 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:10:52 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Flow 'volume_create_manager' (cad5c505-e561-4b7a-84cb-d5fa7d0b3481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3334bc53-8580-44c0-81e0-6663aaa1b8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3334bc53-8580-44c0-81e0-6663aaa1b8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1902171368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5560954-d902-4c3a-a0fd-766b21ccf49f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1016cf899f4c438864bb434fe82065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:10:52Z,use_quota=True,user_id='b7983f8c4572420ab4098a8088296658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b25cc2-4b15-4f5a-b0a9-50cd80291648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b25cc2-4b15-4f5a-b0a9-50cd80291648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce569aeb-4634-490a-92e9-89b02319635f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce569aeb-4634-490a-92e9-89b02319635f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5560954-d902-4c3a-a0fd-766b21ccf49f', 'volume_name': 'volume-e5560954-d902-4c3a-a0fd-766b21ccf49f', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63be65c0-ee55-4cde-9c6c-993ea3098949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63be65c0-ee55-4cde-9c6c-993ea3098949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49678525-6924-421a-9334-35e57492a7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:52 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Volume e5560954-d902-4c3a-a0fd-766b21ccf49f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5560954-d902-4c3a-a0fd-766b21ccf49f', 'volume_size': 1} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1902171368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5560954-d902-4c3a-a0fd-766b21ccf49f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1016cf899f4c438864bb434fe82065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:10:52Z,use_quota=True,user_id='b7983f8c4572420ab4098a8088296658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Creating volume e5560954-d902-4c3a-a0fd-766b21ccf49f {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:10:52 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:10:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e5560954-d902-4c3a-a0fd-766b21ccf49f 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:53 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=36, name=volume-e5560954-d902-4c3a-a0fd-766b21ccf49f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:10:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e5560954-d902-4c3a-a0fd-766b21ccf49f 1073741824" returned: 0 in 0.513s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e5560954-d902-4c3a-a0fd-766b21ccf49f {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e5560954-d902-4c3a-a0fd-766b21ccf49f" returned: 0 in 0.152s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:53 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] <== create_volume: return (764ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:10:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:10:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49678525-6924-421a-9334-35e57492a7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5560954-d902-4c3a-a0fd-766b21ccf49f', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49f9e3e-503f-4ccd-91f2-cff14067ded7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:54 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Volume volume-e5560954-d902-4c3a-a0fd-766b21ccf49f (e5560954-d902-4c3a-a0fd-766b21ccf49f): created successfully Sep 22 11:10:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49f9e3e-503f-4ccd-91f2-cff14067ded7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Flow 'volume_create_manager' (cad5c505-e561-4b7a-84cb-d5fa7d0b3481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:10:54 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-b559826f-e417-42b4-8e84-0d90e43a0f79 tempest-VolumesTransfersV357Test-692690982 None] Created volume successfully. Sep 22 11:10:55 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-96cf1cd4-9b64-445d-be9f-fbbc2be4db2b tempest-VolumesTransfersV357Test-1842129758 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:10:55 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-96cf1cd4-9b64-445d-be9f-fbbc2be4db2b tempest-VolumesTransfersV357Test-1842129758 None] Transfer volume completed successfully. Sep 22 11:10:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] Acquiring lock "cinder-e5560954-d902-4c3a-a0fd-766b21ccf49f-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:10:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] Lock "cinder-e5560954-d902-4c3a-a0fd-766b21ccf49f-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:10:56 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:10:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] Acquiring lock "cinder-quobyte-e5560954-d902-4c3a-a0fd-766b21ccf49f" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:10:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] Lock "cinder-quobyte-e5560954-d902-4c3a-a0fd-766b21ccf49f" acquired by "delete_volume" :: waited 0.024s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:10:56 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[892f231b-83c0-4344-b757-6774678f4a8f]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:10:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e5560954-d902-4c3a-a0fd-766b21ccf49f {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:57 devstack quobyte-client[83313]: System call of process 89898 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:10:57 devstack quobyte-client[83313]: System call of process 89898 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:10:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e5560954-d902-4c3a-a0fd-766b21ccf49f" returned: 0 in 0.574s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e5560954-d902-4c3a-a0fd-766b21ccf49f {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e5560954-d902-4c3a-a0fd-766b21ccf49f" returned: 0 in 0.117s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] Lock "cinder-quobyte-e5560954-d902-4c3a-a0fd-766b21ccf49f" released by "delete_volume" :: held 0.914s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:10:57 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] Created reservations ['01c6c274-640b-4daf-a825-fd9e1e54dde9', '827079bd-f916-4f81-aa5e-6ed4aecc56ea', 'e9299282-3453-4ced-b94c-cdb60480ace0', 'a437aeb5-6de3-4c0f-891a-e28733c45f81'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:10:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:10:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:10:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:10:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:10:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:10:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.139s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:10:58 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:10:58 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] Deleted volume successfully. Sep 22 11:10:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2a588e72-2a28-45e1-b518-6192f1e4557f tempest-VolumesTransfersV357Test-558973722 None] Lock "cinder-e5560954-d902-4c3a-a0fd-766b21ccf49f-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:10:59 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Flow 'volume_create_manager' (267a5fef-f6a9-4a52-b689-58c04936fc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b8eb01-274e-4a6f-88a1-c07dbf3fb025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b8eb01-274e-4a6f-88a1-c07dbf3fb025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-6915219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b19014-b8ae-4511-8569-1f4bdea3b812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1016cf899f4c438864bb434fe82065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:10:59Z,use_quota=True,user_id='b7983f8c4572420ab4098a8088296658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec78db86-c7e4-415b-9329-601863602b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec78db86-c7e4-415b-9329-601863602b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1271a5-d769-4999-9501-8da7c88dd24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1271a5-d769-4999-9501-8da7c88dd24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77b19014-b8ae-4511-8569-1f4bdea3b812', 'volume_name': 'volume-77b19014-b8ae-4511-8569-1f4bdea3b812', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57cff166-e6ff-4b15-9513-c006a211cfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57cff166-e6ff-4b15-9513-c006a211cfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e55bb2c7-5ae1-4760-a8f8-82587291562f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:10:59 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Volume 77b19014-b8ae-4511-8569-1f4bdea3b812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77b19014-b8ae-4511-8569-1f4bdea3b812', 'volume_size': 1} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-6915219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b19014-b8ae-4511-8569-1f4bdea3b812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1016cf899f4c438864bb434fe82065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:10:59Z,use_quota=True,user_id='b7983f8c4572420ab4098a8088296658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Creating volume 77b19014-b8ae-4511-8569-1f4bdea3b812 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:10:59 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:10:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-77b19014-b8ae-4511-8569-1f4bdea3b812 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:10:59 devstack quobyte-client[83313]: System call of process 89906 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:10:59 devstack quobyte-client[83313]: System call of process 89906 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:10:59 devstack quobyte-client[83313]: System call of process 89906 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:10:59 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=37, name=volume-77b19014-b8ae-4511-8569-1f4bdea3b812, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:11:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-77b19014-b8ae-4511-8569-1f4bdea3b812 1073741824" returned: 0 in 0.464s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-77b19014-b8ae-4511-8569-1f4bdea3b812 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-77b19014-b8ae-4511-8569-1f4bdea3b812" returned: 0 in 0.115s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:00 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] <== create_volume: return (790ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:11:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:11:00 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e55bb2c7-5ae1-4760-a8f8-82587291562f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77b19014-b8ae-4511-8569-1f4bdea3b812', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:00 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb4c7a6-1cc1-4f93-98d4-ef675c97ee40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:00 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Volume volume-77b19014-b8ae-4511-8569-1f4bdea3b812 (77b19014-b8ae-4511-8569-1f4bdea3b812): created successfully Sep 22 11:11:00 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb4c7a6-1cc1-4f93-98d4-ef675c97ee40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:00 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Flow 'volume_create_manager' (267a5fef-f6a9-4a52-b689-58c04936fc21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:11:00 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-8321fb82-f0b9-4350-87c6-8123abeed7c8 tempest-VolumesTransfersV357Test-692690982 None] Created volume successfully. Sep 22 11:11:01 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] Acquiring lock "cinder-77b19014-b8ae-4511-8569-1f4bdea3b812-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:11:01 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] Lock "cinder-77b19014-b8ae-4511-8569-1f4bdea3b812-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:11:02 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:11:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] Acquiring lock "cinder-quobyte-77b19014-b8ae-4511-8569-1f4bdea3b812" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:11:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] Lock "cinder-quobyte-77b19014-b8ae-4511-8569-1f4bdea3b812" acquired by "delete_volume" :: waited 0.017s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:11:02 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[97558304-bbcc-4dd0-a68d-ac3fd21ba285]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:11:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-77b19014-b8ae-4511-8569-1f4bdea3b812 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:02 devstack quobyte-client[83313]: System call of process 89910 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-77b19014-b8ae-4511-8569-1f4bdea3b812" returned: 0 in 0.468s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-77b19014-b8ae-4511-8569-1f4bdea3b812 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-77b19014-b8ae-4511-8569-1f4bdea3b812" returned: 0 in 0.175s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] Lock "cinder-quobyte-77b19014-b8ae-4511-8569-1f4bdea3b812" released by "delete_volume" :: held 0.801s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:11:03 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] Created reservations ['e9263919-9c37-4274-98e9-86b7aecb709a', '273cca4d-a0e7-4006-9fec-9352b57308e5', '347672fa-1822-46a1-82bf-f8383e2c4432', 'b6e55512-97f0-45f5-95be-fa5021c972f6'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:11:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:11:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:11:03 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:11:03 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:11:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:11:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.227s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:03 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:11:04 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] Deleted volume successfully. Sep 22 11:11:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-92de1a00-f0fe-4f77-9606-b2a9278d35e5 tempest-VolumesTransfersV357Test-558973722 None] Lock "cinder-77b19014-b8ae-4511-8569-1f4bdea3b812-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:11:12 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Flow 'volume_create_manager' (b17158be-c329-464d-a978-fc965b762ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4310f1b-9927-404e-bc7a-5d3d84686935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4310f1b-9927-404e-bc7a-5d3d84686935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1196737988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c1ac04-0b6c-4123-8e54-5bf7b550015e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='62a06b7a38c94f88abcc1e3702f0d981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:11:12Z,use_quota=True,user_id='dcdd1667cd404a95b26e2b409b35048f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44905477-a574-46fe-92bf-331ce6524c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44905477-a574-46fe-92bf-331ce6524c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40c9a730-8bf9-40b1-b2cb-a9cf8e517059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40c9a730-8bf9-40b1-b2cb-a9cf8e517059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0c1ac04-0b6c-4123-8e54-5bf7b550015e', 'volume_name': 'volume-b0c1ac04-0b6c-4123-8e54-5bf7b550015e', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea32e63-e120-4416-8d03-cd5c77083522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea32e63-e120-4416-8d03-cd5c77083522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5e405d-1ea9-488c-a7e3-672703b02198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:12 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Volume b0c1ac04-0b6c-4123-8e54-5bf7b550015e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0c1ac04-0b6c-4123-8e54-5bf7b550015e', 'volume_size': 1} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1196737988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c1ac04-0b6c-4123-8e54-5bf7b550015e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='62a06b7a38c94f88abcc1e3702f0d981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:11:12Z,use_quota=True,user_id='dcdd1667cd404a95b26e2b409b35048f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Creating volume b0c1ac04-0b6c-4123-8e54-5bf7b550015e {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:11:12 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:11:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b0c1ac04-0b6c-4123-8e54-5bf7b550015e 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:12 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=38, name=volume-b0c1ac04-0b6c-4123-8e54-5bf7b550015e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:11:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b0c1ac04-0b6c-4123-8e54-5bf7b550015e 1073741824" returned: 0 in 0.397s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b0c1ac04-0b6c-4123-8e54-5bf7b550015e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b0c1ac04-0b6c-4123-8e54-5bf7b550015e" returned: 0 in 0.154s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:13 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] <== create_volume: return (644ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:11:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.661s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:11:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5e405d-1ea9-488c-a7e3-672703b02198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0c1ac04-0b6c-4123-8e54-5bf7b550015e', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e782712-d4af-4f0b-91e1-343a44e9f97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:13 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Volume volume-b0c1ac04-0b6c-4123-8e54-5bf7b550015e (b0c1ac04-0b6c-4123-8e54-5bf7b550015e): created successfully Sep 22 11:11:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e782712-d4af-4f0b-91e1-343a44e9f97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Flow 'volume_create_manager' (b17158be-c329-464d-a978-fc965b762ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:11:13 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-8cdfab36-b2f9-4a02-bd46-1cc80a35474b tempest-VolumesListTestJSON-1912386699 None] Created volume successfully. Sep 22 11:11:14 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:11:14 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:11:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Flow 'volume_create_manager' (f8dd9d78-460a-48c8-9b44-6c85fe2e3521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:11:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e6e788-b0aa-4d1c-98cd-a7f809676831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e6e788-b0aa-4d1c-98cd-a7f809676831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-963520328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871b7dd2-a3be-4962-a051-fe165ec49acc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acaed8fcef1c46a4a9a5037ef028f730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:11:15Z,use_quota=True,user_id='0087695291fe4f1c809be7c38ecb5564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ba99f3-b75b-4d22-8d81-adecc8d1bb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ba99f3-b75b-4d22-8d81-adecc8d1bb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e4ac82-de53-4443-a8c9-fcbd1e520aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e4ac82-de53-4443-a8c9-fcbd1e520aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '871b7dd2-a3be-4962-a051-fe165ec49acc', 'volume_name': 'volume-871b7dd2-a3be-4962-a051-fe165ec49acc', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e7ccd8-b449-4935-8de7-b18f7d35991a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e7ccd8-b449-4935-8de7-b18f7d35991a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f419dd-3bed-46e6-8310-85268ffafd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:14 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Volume 871b7dd2-a3be-4962-a051-fe165ec49acc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-871b7dd2-a3be-4962-a051-fe165ec49acc', 'volume_size': 1} Sep 22 11:11:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:11:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:11:14 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-963520328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871b7dd2-a3be-4962-a051-fe165ec49acc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acaed8fcef1c46a4a9a5037ef028f730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:11:15Z,use_quota=True,user_id='0087695291fe4f1c809be7c38ecb5564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:11:14 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Creating volume 871b7dd2-a3be-4962-a051-fe165ec49acc {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:11:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:11:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:11:14 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:11:15 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:11:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:11:15 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:11:15 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:11:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-871b7dd2-a3be-4962-a051-fe165ec49acc 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:15 devstack quobyte-client[83313]: System call of process 89928 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:15 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=39, name=volume-871b7dd2-a3be-4962-a051-fe165ec49acc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:11:15 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:11:15 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:11:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Flow 'volume_create_manager' (706a2db0-1711-47b4-9975-2ec6928c8556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:11:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05403036-894b-46f0-876f-54d97287ad63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05403036-894b-46f0-876f-54d97287ad63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1189862821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53eb7b0c-e4dc-4958-a87c-d057d46a8e7f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='62a06b7a38c94f88abcc1e3702f0d981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:11:15Z,use_quota=True,user_id='dcdd1667cd404a95b26e2b409b35048f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899dc2a1-fd05-46dd-8500-4666bcbb90a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899dc2a1-fd05-46dd-8500-4666bcbb90a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d67507-1c0c-4219-beea-1861c6c4ebaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d67507-1c0c-4219-beea-1861c6c4ebaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53eb7b0c-e4dc-4958-a87c-d057d46a8e7f', 'volume_name': 'volume-53eb7b0c-e4dc-4958-a87c-d057d46a8e7f', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662f490b-fc8e-48bd-a4bf-3ec85423e834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662f490b-fc8e-48bd-a4bf-3ec85423e834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d9b541-02c6-4aee-b700-7caf0a2227af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:15 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Volume 53eb7b0c-e4dc-4958-a87c-d057d46a8e7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53eb7b0c-e4dc-4958-a87c-d057d46a8e7f', 'volume_size': 1} Sep 22 11:11:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:11:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-871b7dd2-a3be-4962-a051-fe165ec49acc 1073741824" returned: 0 in 1.111s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-871b7dd2-a3be-4962-a051-fe165ec49acc {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-871b7dd2-a3be-4962-a051-fe165ec49acc" returned: 0 in 0.128s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] <== create_volume: return (1302ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:11:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:11:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.544s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:11:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1189862821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53eb7b0c-e4dc-4958-a87c-d057d46a8e7f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='62a06b7a38c94f88abcc1e3702f0d981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:11:15Z,use_quota=True,user_id='dcdd1667cd404a95b26e2b409b35048f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:11:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Creating volume 53eb7b0c-e4dc-4958-a87c-d057d46a8e7f {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:11:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:11:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:11:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:11:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:11:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:11:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:11:16 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:11:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-53eb7b0c-e4dc-4958-a87c-d057d46a8e7f 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:16 devstack quobyte-client[83313]: System call of process 89959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:16 devstack quobyte-client[83313]: System call of process 89959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:16 devstack quobyte-client[83313]: System call of process 89959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:16 devstack quobyte-client[83313]: System call of process 89959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:16 devstack quobyte-client[83313]: System call of process 89959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f419dd-3bed-46e6-8310-85268ffafd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-871b7dd2-a3be-4962-a051-fe165ec49acc', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:16 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=40, name=volume-53eb7b0c-e4dc-4958-a87c-d057d46a8e7f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:11:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4bf6b0-157c-410c-8ab2-bf67796c42bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:17 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Volume volume-871b7dd2-a3be-4962-a051-fe165ec49acc (871b7dd2-a3be-4962-a051-fe165ec49acc): created successfully Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4bf6b0-157c-410c-8ab2-bf67796c42bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Flow 'volume_create_manager' (f8dd9d78-460a-48c8-9b44-6c85fe2e3521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-53eb7b0c-e4dc-4958-a87c-d057d46a8e7f 1073741824" returned: 0 in 0.598s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-53eb7b0c-e4dc-4958-a87c-d057d46a8e7f {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:17 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-d9e03f06-9a1a-4934-b13f-755064697e6b tempest-AttachVolumeShelveTestJSON-1546792471 None] Created volume successfully. Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-53eb7b0c-e4dc-4958-a87c-d057d46a8e7f" returned: 0 in 0.437s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] <== create_volume: return (1097ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.279s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d9b541-02c6-4aee-b700-7caf0a2227af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53eb7b0c-e4dc-4958-a87c-d057d46a8e7f', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304cbb03-7d43-4008-9cb5-424458ce794e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:17 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Volume volume-53eb7b0c-e4dc-4958-a87c-d057d46a8e7f (53eb7b0c-e4dc-4958-a87c-d057d46a8e7f): created successfully Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304cbb03-7d43-4008-9cb5-424458ce794e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Flow 'volume_create_manager' (706a2db0-1711-47b4-9975-2ec6928c8556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:11:17 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-41e56e7a-6b7a-43f6-a8aa-7cb7df2ae88d tempest-VolumesListTestJSON-1912386699 None] Created volume successfully. Sep 22 11:11:18 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Flow 'volume_create_manager' (5c35097a-b58c-46b5-887c-7f043801dfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f03e0c-0ffa-4d54-9727-06eb010d79a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f03e0c-0ffa-4d54-9727-06eb010d79a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1675331821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872f2d92-0fc6-4f51-a56b-c170ed8b1383,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='62a06b7a38c94f88abcc1e3702f0d981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:11:19Z,use_quota=True,user_id='dcdd1667cd404a95b26e2b409b35048f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11792c56-18f4-4087-9074-f0d1e9033ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11792c56-18f4-4087-9074-f0d1e9033ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4c15e5-89f5-4773-b851-e9c7a0f18ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4c15e5-89f5-4773-b851-e9c7a0f18ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '872f2d92-0fc6-4f51-a56b-c170ed8b1383', 'volume_name': 'volume-872f2d92-0fc6-4f51-a56b-c170ed8b1383', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c219692-e170-4784-bca0-dbe371473aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c219692-e170-4784-bca0-dbe371473aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82dbfad-34d6-408e-859e-f93e6977c729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:18 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Volume 872f2d92-0fc6-4f51-a56b-c170ed8b1383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-872f2d92-0fc6-4f51-a56b-c170ed8b1383', 'volume_size': 1} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1675331821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872f2d92-0fc6-4f51-a56b-c170ed8b1383,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='62a06b7a38c94f88abcc1e3702f0d981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:11:19Z,use_quota=True,user_id='dcdd1667cd404a95b26e2b409b35048f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Creating volume 872f2d92-0fc6-4f51-a56b-c170ed8b1383 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:11:18 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:11:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-872f2d92-0fc6-4f51-a56b-c170ed8b1383 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:19 devstack quobyte-client[83313]: System call of process 89969 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:19 devstack quobyte-client[83313]: System call of process 89969 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:19 devstack quobyte-client[83313]: System call of process 89969 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:19 devstack quobyte-client[83313]: System call of process 89969 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:19 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=41, name=volume-872f2d92-0fc6-4f51-a56b-c170ed8b1383, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:11:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-872f2d92-0fc6-4f51-a56b-c170ed8b1383 1073741824" returned: 0 in 0.460s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-872f2d92-0fc6-4f51-a56b-c170ed8b1383 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-872f2d92-0fc6-4f51-a56b-c170ed8b1383" returned: 0 in 0.121s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:19 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] <== create_volume: return (697ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:11:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:11:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82dbfad-34d6-408e-859e-f93e6977c729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-872f2d92-0fc6-4f51-a56b-c170ed8b1383', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692f9297-0662-4a8b-9383-91c9de6072cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:19 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Volume volume-872f2d92-0fc6-4f51-a56b-c170ed8b1383 (872f2d92-0fc6-4f51-a56b-c170ed8b1383): created successfully Sep 22 11:11:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (692f9297-0662-4a8b-9383-91c9de6072cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Flow 'volume_create_manager' (5c35097a-b58c-46b5-887c-7f043801dfb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:11:19 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-cf64b093-7861-4660-8435-30b0e3d8830d tempest-VolumesListTestJSON-1912386699 None] Created volume successfully. Sep 22 11:11:28 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] Acquiring lock "cinder-872f2d92-0fc6-4f51-a56b-c170ed8b1383-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:11:28 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] Lock "cinder-872f2d92-0fc6-4f51-a56b-c170ed8b1383-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:11:28 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:11:28 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] Acquiring lock "cinder-quobyte-872f2d92-0fc6-4f51-a56b-c170ed8b1383" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:11:29 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] Lock "cinder-quobyte-872f2d92-0fc6-4f51-a56b-c170ed8b1383" acquired by "delete_volume" :: waited 0.022s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:11:29 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f312ba35-8bcf-4ea5-bdae-66fa877e42b7]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:11:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-872f2d92-0fc6-4f51-a56b-c170ed8b1383 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:30 devstack quobyte-client[83313]: System call of process 90035 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:30 devstack quobyte-client[83313]: System call of process 90035 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:30 devstack quobyte-client[83313]: System call of process 90035 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-872f2d92-0fc6-4f51-a56b-c170ed8b1383" returned: 0 in 1.027s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-872f2d92-0fc6-4f51-a56b-c170ed8b1383 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-872f2d92-0fc6-4f51-a56b-c170ed8b1383" returned: 0 in 0.124s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:30 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] Lock "cinder-quobyte-872f2d92-0fc6-4f51-a56b-c170ed8b1383" released by "delete_volume" :: held 1.433s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:11:30 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] Created reservations ['f26f7ffb-2e90-4a0d-b4e8-a4a9984ace5d', '31d66351-6074-4cc9-9277-f19575e4769c', 'd102f0c8-d2f8-4008-9389-b111859c35dd', '2822a6cc-2bf6-49a7-8733-88fd5c2ee9bb'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:11:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:11:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:11:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:11:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:11:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:11:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.325s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:31 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:11:31 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] Deleted volume successfully. Sep 22 11:11:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] Acquiring lock "cinder-53eb7b0c-e4dc-4958-a87c-d057d46a8e7f-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:11:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6ca67e7f-4137-45b5-9669-65ee6eed5b68 tempest-VolumesListTestJSON-1912386699 None] Lock "cinder-872f2d92-0fc6-4f51-a56b-c170ed8b1383-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:11:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] Lock "cinder-53eb7b0c-e4dc-4958-a87c-d057d46a8e7f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:11:31 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:11:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] Acquiring lock "cinder-quobyte-53eb7b0c-e4dc-4958-a87c-d057d46a8e7f" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:11:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] Lock "cinder-quobyte-53eb7b0c-e4dc-4958-a87c-d057d46a8e7f" acquired by "delete_volume" :: waited 0.010s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:11:31 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[445ee441-8093-4a6b-a294-673d08758a01]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:11:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-53eb7b0c-e4dc-4958-a87c-d057d46a8e7f {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:32 devstack quobyte-client[83313]: System call of process 90048 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-53eb7b0c-e4dc-4958-a87c-d057d46a8e7f" returned: 0 in 0.604s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-53eb7b0c-e4dc-4958-a87c-d057d46a8e7f {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-53eb7b0c-e4dc-4958-a87c-d057d46a8e7f" returned: 0 in 0.124s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:32 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] Lock "cinder-quobyte-53eb7b0c-e4dc-4958-a87c-d057d46a8e7f" released by "delete_volume" :: held 0.924s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:11:33 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] Created reservations ['ace0811e-f914-4c3b-9e3f-cf6c8e47097c', '9d329607-abba-410b-9eea-02cf2216c2ad', '34ea0de2-0997-43b0-8442-53351bbe243c', 'c0a46151-a7fb-426d-9fdc-99b675a9b9f1'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:11:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:11:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:11:33 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:11:33 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:11:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:11:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.143s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:33 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:11:33 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] Deleted volume successfully. Sep 22 11:11:33 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-938c153b-f277-4d94-8f3c-92be0231ea8d tempest-VolumesListTestJSON-1912386699 None] Lock "cinder-53eb7b0c-e4dc-4958-a87c-d057d46a8e7f-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:11:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] Acquiring lock "cinder-b0c1ac04-0b6c-4123-8e54-5bf7b550015e-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:11:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] Lock "cinder-b0c1ac04-0b6c-4123-8e54-5bf7b550015e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:11:34 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:11:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] Acquiring lock "cinder-quobyte-b0c1ac04-0b6c-4123-8e54-5bf7b550015e" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:11:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] Lock "cinder-quobyte-b0c1ac04-0b6c-4123-8e54-5bf7b550015e" acquired by "delete_volume" :: waited 0.011s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:11:34 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eac6666-2606-438e-bc30-b7f6e30a2887]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:11:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b0c1ac04-0b6c-4123-8e54-5bf7b550015e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:34 devstack quobyte-client[83313]: System call of process 90054 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b0c1ac04-0b6c-4123-8e54-5bf7b550015e" returned: 0 in 0.480s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b0c1ac04-0b6c-4123-8e54-5bf7b550015e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b0c1ac04-0b6c-4123-8e54-5bf7b550015e" returned: 0 in 0.088s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:35 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] Lock "cinder-quobyte-b0c1ac04-0b6c-4123-8e54-5bf7b550015e" released by "delete_volume" :: held 0.716s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:11:35 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] Created reservations ['edb6e284-6968-4bb2-ae56-3bfd6e33215d', 'bb2df233-b75d-4511-9c13-d61f8ca88251', 'c9eb5276-53ce-4f44-810d-e13ef5217ccd', 'e21442a3-07fc-4c9d-8cf4-2484653598f9'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:11:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:11:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:11:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:11:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:11:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:11:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.083s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:35 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:11:35 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] Deleted volume successfully. Sep 22 11:11:35 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-24034e01-6341-42c7-9acb-cc71bc2c2696 tempest-VolumesListTestJSON-1912386699 None] Lock "cinder-b0c1ac04-0b6c-4123-8e54-5bf7b550015e-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:11:40 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:11:40 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:11:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Flow 'volume_create_manager' (c7c2220e-0f7c-44f3-a63c-96ab8b99e7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536badb5-48df-4a52-9552-7fcae00c0e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536badb5-48df-4a52-9552-7fcae00c0e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-573689100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b888a8-1981-4185-b35b-6f1af5482bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763107e7df7d4f8885d5eaf820e543ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:11:41Z,use_quota=True,user_id='9064bb84fdf944efb718af3c11b50084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70aad39b-bf48-41db-a327-98b18f0016f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70aad39b-bf48-41db-a327-98b18f0016f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d46c793-1f47-492c-80f3-b9d60a3caad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d46c793-1f47-492c-80f3-b9d60a3caad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81b888a8-1981-4185-b35b-6f1af5482bc6', 'volume_name': 'volume-81b888a8-1981-4185-b35b-6f1af5482bc6', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e089e27c-f973-4034-85bb-eaac213da213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e089e27c-f973-4034-85bb-eaac213da213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b5fa32-7886-4b33-9f65-9786e3cee9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:41 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Volume 81b888a8-1981-4185-b35b-6f1af5482bc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81b888a8-1981-4185-b35b-6f1af5482bc6', 'volume_size': 1} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-573689100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b888a8-1981-4185-b35b-6f1af5482bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763107e7df7d4f8885d5eaf820e543ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:11:41Z,use_quota=True,user_id='9064bb84fdf944efb718af3c11b50084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Creating volume 81b888a8-1981-4185-b35b-6f1af5482bc6 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:11:41 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:41 devstack quobyte-client[83313]: System call of process 90070 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:41 devstack quobyte-client[83313]: System call of process 90070 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:41 devstack quobyte-client[83313]: System call of process 90070 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:41 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=42, name=volume-81b888a8-1981-4185-b35b-6f1af5482bc6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6 1073741824" returned: 0 in 0.434s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6" returned: 0 in 0.124s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] <== create_volume: return (765ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:11:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:11:42 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-b577c3ac-9655-4e9a-9d45-fa2c1506890e req-3094c109-4b7f-4b13-b13d-ac5926a7e56a tempest-AttachVolumeShelveTestJSON-1546792471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:11:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b5fa32-7886-4b33-9f65-9786e3cee9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81b888a8-1981-4185-b35b-6f1af5482bc6', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a770e146-2900-4a19-8fd1-b601092ecfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:11:42 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-b577c3ac-9655-4e9a-9d45-fa2c1506890e req-3094c109-4b7f-4b13-b13d-ac5926a7e56a tempest-AttachVolumeShelveTestJSON-1546792471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:11:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-b577c3ac-9655-4e9a-9d45-fa2c1506890e req-3094c109-4b7f-4b13-b13d-ac5926a7e56a tempest-AttachVolumeShelveTestJSON-1546792471 None] No connector for attachment 836aa327-d108-41b8-a3d2-c0c7445231e4; skipping storage backend terminate_connection call. {{(pid=83310) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}} Sep 22 11:11:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-b577c3ac-9655-4e9a-9d45-fa2c1506890e req-3094c109-4b7f-4b13-b13d-ac5926a7e56a tempest-AttachVolumeShelveTestJSON-1546792471 None] Deleting attachment 836aa327-d108-41b8-a3d2-c0c7445231e4. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:11:42 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Volume volume-81b888a8-1981-4185-b35b-6f1af5482bc6 (81b888a8-1981-4185-b35b-6f1af5482bc6): created successfully Sep 22 11:11:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a770e146-2900-4a19-8fd1-b601092ecfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:11:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Flow 'volume_create_manager' (c7c2220e-0f7c-44f3-a63c-96ab8b99e7d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:11:42 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-a109c9e8-ff10-4e48-ba09-0d1deb0468d5 tempest-VolumesSnapshotListTestJSON-1044185744 None] Created volume successfully. Sep 22 11:11:43 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:11:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:11:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:11:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] Creating offline snapshot e0f12406-3cb8-47ce-a0e6-495742e8f0ef of volume 81b888a8-1981-4185-b35b-6f1af5482bc6 {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:11:43 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf99f84-82fa-4e6b-b152-61a15930a75d]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:11:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:44 devstack quobyte-client[83313]: System call of process 90081 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:44 devstack quobyte-client[83313]: System call of process 90081 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6" returned: 0 in 0.624s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:44 devstack quobyte-client[83313]: System call of process 90084 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:44 devstack quobyte-client[83313]: System call of process 90084 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:44 devstack quobyte-client[83313]: System call of process 90084 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:44 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=43, name=volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:11:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef 1G" returned: 0 in 0.336s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): qemu-img rebase -u -b volume-81b888a8-1981-4185-b35b-6f1af5482bc6 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:44 devstack quobyte-client[83313]: System call of process 90087 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "qemu-img rebase -u -b volume-81b888a8-1981-4185-b35b-6f1af5482bc6 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef" returned: 0 in 0.366s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:11:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef" returned: 0 in 0.088s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:45 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6 -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:11:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef" returned: 0 in 0.093s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.info" returned: 0 in 0.113s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:45 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:11:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.info" returned: 0 in 0.098s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.178s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:11:45 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-820ca830-67b4-4f1f-93a3-fa6cedfca740 tempest-VolumesSnapshotListTestJSON-1044185744 None] Create snapshot completed successfully Sep 22 11:11:46 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-7d9850ce-b374-4617-8616-860cd8f24c27 tempest-VolumesSnapshotListTestJSON-1044185744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:11:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7d9850ce-b374-4617-8616-860cd8f24c27 tempest-VolumesSnapshotListTestJSON-1044185744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:11:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7d9850ce-b374-4617-8616-860cd8f24c27 tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:11:46 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-7d9850ce-b374-4617-8616-860cd8f24c27 tempest-VolumesSnapshotListTestJSON-1044185744 None] Creating offline snapshot f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2 of volume 81b888a8-1981-4185-b35b-6f1af5482bc6 {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:11:46 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[03504003-d16f-4401-9ef6-c00f99545f2c]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:11:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7d9850ce-b374-4617-8616-860cd8f24c27 tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7d9850ce-b374-4617-8616-860cd8f24c27 tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef" returned: 0 in 0.533s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-7d9850ce-b374-4617-8616-860cd8f24c27 tempest-VolumesSnapshotListTestJSON-1044185744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81b888a8-1981-4185-b35b-6f1af5482bc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:11:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7d9850ce-b374-4617-8616-860cd8f24c27 tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:47 devstack quobyte-client[83313]: System call of process 90097 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:47 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=45, name=volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:11:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7d9850ce-b374-4617-8616-860cd8f24c27 tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2 1G" returned: 0 in 0.338s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7d9850ce-b374-4617-8616-860cd8f24c27 tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): qemu-img rebase -u -b volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7d9850ce-b374-4617-8616-860cd8f24c27 tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "qemu-img rebase -u -b volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2" returned: 0 in 0.162s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:48 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-7d9850ce-b374-4617-8616-860cd8f24c27 tempest-VolumesSnapshotListTestJSON-1044185744 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2 is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:11:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7d9850ce-b374-4617-8616-860cd8f24c27 tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7d9850ce-b374-4617-8616-860cd8f24c27 tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2" returned: 0 in 0.090s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:48 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-7d9850ce-b374-4617-8616-860cd8f24c27 tempest-VolumesSnapshotListTestJSON-1044185744 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:11:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7d9850ce-b374-4617-8616-860cd8f24c27 tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7d9850ce-b374-4617-8616-860cd8f24c27 tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2" returned: 0 in 0.098s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7d9850ce-b374-4617-8616-860cd8f24c27 tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.633s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:11:49 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-7d9850ce-b374-4617-8616-860cd8f24c27 tempest-VolumesSnapshotListTestJSON-1044185744 None] Create snapshot completed successfully Sep 22 11:11:50 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-49dd6caf-4aeb-4cdc-b761-14d4487a2871 tempest-VolumesSnapshotListTestJSON-1044185744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:11:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-49dd6caf-4aeb-4cdc-b761-14d4487a2871 tempest-VolumesSnapshotListTestJSON-1044185744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:11:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-49dd6caf-4aeb-4cdc-b761-14d4487a2871 tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:11:50 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-49dd6caf-4aeb-4cdc-b761-14d4487a2871 tempest-VolumesSnapshotListTestJSON-1044185744 None] Creating offline snapshot 23a48ca3-562d-4b64-8efa-ad0e723fe59d of volume 81b888a8-1981-4185-b35b-6f1af5482bc6 {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:11:50 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc16548b-de89-4033-a18f-3785d2fbb2ab]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:11:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-49dd6caf-4aeb-4cdc-b761-14d4487a2871 tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-49dd6caf-4aeb-4cdc-b761-14d4487a2871 tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2" returned: 0 in 0.633s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-49dd6caf-4aeb-4cdc-b761-14d4487a2871 tempest-VolumesSnapshotListTestJSON-1044185744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81b888a8-1981-4185-b35b-6f1af5482bc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:11:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-49dd6caf-4aeb-4cdc-b761-14d4487a2871 tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.23a48ca3-562d-4b64-8efa-ad0e723fe59d 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:51 devstack quobyte-client[83313]: System call of process 90109 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:51 devstack quobyte-client[83313]: System call of process 90109 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:51 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=46, name=volume-81b888a8-1981-4185-b35b-6f1af5482bc6.23a48ca3-562d-4b64-8efa-ad0e723fe59d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:11:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-49dd6caf-4aeb-4cdc-b761-14d4487a2871 tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.23a48ca3-562d-4b64-8efa-ad0e723fe59d 1G" returned: 0 in 0.384s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-49dd6caf-4aeb-4cdc-b761-14d4487a2871 tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): qemu-img rebase -u -b volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.23a48ca3-562d-4b64-8efa-ad0e723fe59d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:51 devstack quobyte-client[83313]: System call of process 90112 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:51 devstack quobyte-client[83313]: System call of process 90112 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-49dd6caf-4aeb-4cdc-b761-14d4487a2871 tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "qemu-img rebase -u -b volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.23a48ca3-562d-4b64-8efa-ad0e723fe59d" returned: 0 in 0.218s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-49dd6caf-4aeb-4cdc-b761-14d4487a2871 tempest-VolumesSnapshotListTestJSON-1044185744 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.23a48ca3-562d-4b64-8efa-ad0e723fe59d is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:11:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-49dd6caf-4aeb-4cdc-b761-14d4487a2871 tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.23a48ca3-562d-4b64-8efa-ad0e723fe59d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-49dd6caf-4aeb-4cdc-b761-14d4487a2871 tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.23a48ca3-562d-4b64-8efa-ad0e723fe59d" returned: 0 in 0.158s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-49dd6caf-4aeb-4cdc-b761-14d4487a2871 tempest-VolumesSnapshotListTestJSON-1044185744 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2 -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:11:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-49dd6caf-4aeb-4cdc-b761-14d4487a2871 tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.23a48ca3-562d-4b64-8efa-ad0e723fe59d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-49dd6caf-4aeb-4cdc-b761-14d4487a2871 tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.23a48ca3-562d-4b64-8efa-ad0e723fe59d" returned: 0 in 0.137s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-49dd6caf-4aeb-4cdc-b761-14d4487a2871 tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.963s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:11:52 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=35,cinder:UPDATE=64,cinder:DELETE=10,cinder:INSERT=7 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:11:52 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=50,cinder:SELECT=41,cinder:DELETE=4,cinder:INSERT=13 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:11:52 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-49dd6caf-4aeb-4cdc-b761-14d4487a2871 tempest-VolumesSnapshotListTestJSON-1044185744 None] Create snapshot completed successfully Sep 22 11:11:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] Acquiring lock "cinder-23a48ca3-562d-4b64-8efa-ad0e723fe59d-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:11:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-23a48ca3-562d-4b64-8efa-ad0e723fe59d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:11:55 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:11:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] Acquiring lock "cinder-quobyte-81b888a8-1981-4185-b35b-6f1af5482bc6" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:11:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-quobyte-81b888a8-1981-4185-b35b-6f1af5482bc6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:11:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] Acquiring lock "cinder-quobyte-23a48ca3-562d-4b64-8efa-ad0e723fe59d" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:11:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-quobyte-23a48ca3-562d-4b64-8efa-ad0e723fe59d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:11:55 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] Deleting offline snapshot 23a48ca3-562d-4b64-8efa-ad0e723fe59d of volume 81b888a8-1981-4185-b35b-6f1af5482bc6 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:11:55 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] snapshot_file for this snap is: volume-81b888a8-1981-4185-b35b-6f1af5482bc6.23a48ca3-562d-4b64-8efa-ad0e723fe59d {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:11:55 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e9998c-ed61-41c2-a309-c4eaf28e9daf]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:11:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.23a48ca3-562d-4b64-8efa-ad0e723fe59d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:56 devstack quobyte-client[83313]: System call of process 90125 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:56 devstack quobyte-client[83313]: System call of process 90125 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:56 devstack quobyte-client[83313]: System call of process 90125 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.23a48ca3-562d-4b64-8efa-ad0e723fe59d" returned: 0 in 0.789s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81b888a8-1981-4185-b35b-6f1af5482bc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:11:56 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[132e03b7-954f-4425-ae68-35098295cc4a]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:11:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2" returned: 0 in 0.508s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81b888a8-1981-4185-b35b-6f1af5482bc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:11:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.23a48ca3-562d-4b64-8efa-ad0e723fe59d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:56 devstack quobyte-client[83313]: System call of process 90144 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:56 devstack quobyte-client[83313]: System call of process 90144 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:11:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.23a48ca3-562d-4b64-8efa-ad0e723fe59d" returned: 0 in 0.597s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.23a48ca3-562d-4b64-8efa-ad0e723fe59d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:11:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.23a48ca3-562d-4b64-8efa-ad0e723fe59d" returned: 0 in 0.157s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:11:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-quobyte-23a48ca3-562d-4b64-8efa-ad0e723fe59d" released by "_delete_snapshot" :: held 2.501s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:11:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-quobyte-81b888a8-1981-4185-b35b-6f1af5482bc6" released by "delete_snapshot" :: held 2.534s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:11:58 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] Created reservations ['a1c078e6-45ab-4365-901c-7e3256cfa788', 'a9ec20bc-3b7c-4477-9a39-f42227f2672f', 'e0efbc29-3849-451c-8238-b2463a76b9de', '07b226ea-5a37-4f45-86e4-cfcc7b921d2c'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:11:58 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] Delete snapshot completed successfully. Sep 22 11:11:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-61d3d0cf-d5b7-4777-8dce-560f3428066d tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-23a48ca3-562d-4b64-8efa-ad0e723fe59d-delete_snapshot" released by "delete_snapshot" :: held 3.342s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:11:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] Acquiring lock "cinder-f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:11:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:11:59 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:11:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] Acquiring lock "cinder-quobyte-81b888a8-1981-4185-b35b-6f1af5482bc6" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:11:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-quobyte-81b888a8-1981-4185-b35b-6f1af5482bc6" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:11:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] Acquiring lock "cinder-quobyte-f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:11:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-quobyte-f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:11:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] Deleting offline snapshot f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2 of volume 81b888a8-1981-4185-b35b-6f1af5482bc6 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:11:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] snapshot_file for this snap is: volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:11:59 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad39f37a-5ee6-4ddf-b979-c9279a5c4a08]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:11:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2" returned: 0 in 1.645s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:01 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81b888a8-1981-4185-b35b-6f1af5482bc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:12:01 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a3c107-ac20-4be3-8316-0a847e9f6f19]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:12:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:02 devstack quobyte-client[83313]: System call of process 90206 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:12:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef" returned: 0 in 0.858s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:02 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81b888a8-1981-4185-b35b-6f1af5482bc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:12:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:02 devstack quobyte-client[83313]: System call of process 90214 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:12:02 devstack quobyte-client[83313]: System call of process 90214 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:12:02 devstack quobyte-client[83313]: System call of process 90214 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:12:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2" returned: 0 in 0.522s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2" returned: 0 in 0.174s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-quobyte-f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2" released by "_delete_snapshot" :: held 3.792s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:12:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-quobyte-81b888a8-1981-4185-b35b-6f1af5482bc6" released by "delete_snapshot" :: held 3.814s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:12:03 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] Created reservations ['4527a653-8e93-4d31-98f2-bce90882995a', 'e5c84ef1-bd67-4169-9fda-9fd3b1b3c8ae', 'cc28cbc0-c19f-4899-bb62-1f5293db277f', 'c4b704dc-8481-4979-a767-850c2b5a6ee8'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:12:03 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] Delete snapshot completed successfully. Sep 22 11:12:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-41a44afc-5e48-47b1-9420-a9177f29aadf tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-f1dd3e6b-c0f9-48f6-a7ef-14fdb3bd00a2-delete_snapshot" released by "delete_snapshot" :: held 4.499s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:12:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] Acquiring lock "cinder-e0f12406-3cb8-47ce-a0e6-495742e8f0ef-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:12:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-e0f12406-3cb8-47ce-a0e6-495742e8f0ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:12:04 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:12:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] Acquiring lock "cinder-quobyte-81b888a8-1981-4185-b35b-6f1af5482bc6" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:12:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-quobyte-81b888a8-1981-4185-b35b-6f1af5482bc6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:12:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] Acquiring lock "cinder-quobyte-e0f12406-3cb8-47ce-a0e6-495742e8f0ef" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:12:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-quobyte-e0f12406-3cb8-47ce-a0e6-495742e8f0ef" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:12:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] Deleting offline snapshot e0f12406-3cb8-47ce-a0e6-495742e8f0ef of volume 81b888a8-1981-4185-b35b-6f1af5482bc6 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:12:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] snapshot_file for this snap is: volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:12:04 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[0730967e-2a08-43a9-a619-9b193666497d]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:12:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:04 devstack quobyte-client[83313]: System call of process 90221 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:12:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef" returned: 0 in 0.697s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:05 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81b888a8-1981-4185-b35b-6f1af5482bc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:12:05 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[717190ce-1e74-43c1-b2e5-c45349fa70a2]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:12:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:05 devstack quobyte-client[83313]: System call of process 90225 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:12:05 devstack quobyte-client[83313]: System call of process 90225 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:12:05 devstack quobyte-client[83313]: System call of process 90225 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:12:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6" returned: 0 in 0.820s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:06 devstack quobyte-client[83313]: System call of process 90229 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:12:06 devstack quobyte-client[83313]: System call of process 90229 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:12:06 devstack quobyte-client[83313]: System call of process 90229 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:12:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef" returned: 0 in 0.414s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6.e0f12406-3cb8-47ce-a0e6-495742e8f0ef" returned: 0 in 0.270s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:06 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-quobyte-e0f12406-3cb8-47ce-a0e6-495742e8f0ef" released by "_delete_snapshot" :: held 2.761s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:12:06 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-quobyte-81b888a8-1981-4185-b35b-6f1af5482bc6" released by "delete_snapshot" :: held 2.796s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:12:07 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] Created reservations ['af7b22e1-8b01-4824-ac85-4fb53cc1a701', '00c374e3-8307-44de-beba-372fc28bfafe', '671da6b7-2fbd-47c2-b081-9bce2418b21d', '1629d855-939d-43e8-a172-fbe6d32a7dad'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:12:07 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] Delete snapshot completed successfully. Sep 22 11:12:07 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4ae51094-069f-49fb-b84c-eb5d5176846e tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-e0f12406-3cb8-47ce-a0e6-495742e8f0ef-delete_snapshot" released by "delete_snapshot" :: held 3.434s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:12:08 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] Acquiring lock "cinder-81b888a8-1981-4185-b35b-6f1af5482bc6-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:12:08 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-81b888a8-1981-4185-b35b-6f1af5482bc6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:12:08 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:12:08 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] Acquiring lock "cinder-quobyte-81b888a8-1981-4185-b35b-6f1af5482bc6" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:12:08 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-quobyte-81b888a8-1981-4185-b35b-6f1af5482bc6" acquired by "delete_volume" :: waited 0.013s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:12:08 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9f502c-40fe-4a63-ab9c-6d1b1e2bea5b]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:12:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6" returned: 0 in 0.492s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-81b888a8-1981-4185-b35b-6f1af5482bc6" returned: 0 in 0.103s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:09 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-quobyte-81b888a8-1981-4185-b35b-6f1af5482bc6" released by "delete_volume" :: held 0.796s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:12:09 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] Created reservations ['d8751878-5bd2-4785-afe8-22140b679708', 'cb4d4195-5405-46a7-9121-8c201292ace6', '6760012f-5d0b-436e-835b-866e2bc32efe', '9c1c2b98-5a3c-4481-bb00-2d3ec8c321cc'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:12:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:12:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:12:10 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:12:10 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:12:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:12:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.106s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:10 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:12:10 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] Deleted volume successfully. Sep 22 11:12:10 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4a198546-e4ae-4f45-b449-70e9cbf97dfd tempest-VolumesSnapshotListTestJSON-1044185744 None] Lock "cinder-81b888a8-1981-4185-b35b-6f1af5482bc6-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:12:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:12:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:12:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:12:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:12:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:12:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:12:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.454s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:18 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=22,cinder:INSERT=4,cinder:UPDATE=28 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:12:20 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Flow 'volume_create_manager' (c6fcb76c-786a-43c5-af7a-5c3de5bba925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc99b2b-e188-4fe3-a048-9af231a66a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc99b2b-e188-4fe3-a048-9af231a66a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1318692884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e1e352-98bc-4501-bd9a-8439ef5aff0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91025c8886bb4c57b2e7335660fac176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:12:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:12:20Z,use_quota=True,user_id='8a20ad4bad06426f8aee0055220b05a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4234f8c4-1451-48af-a0c9-46549fd1a8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4234f8c4-1451-48af-a0c9-46549fd1a8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cd3500-5e28-4e8d-a19d-0342f6d16b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cd3500-5e28-4e8d-a19d-0342f6d16b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e1e352-98bc-4501-bd9a-8439ef5aff0d', 'volume_name': 'volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d', 'volume_size': 2}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed28ac58-35c7-464e-a8ba-f275ea548dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed28ac58-35c7-464e-a8ba-f275ea548dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c21f2f3f-1bd5-4094-aebb-bc4e1ae5dca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:12:20 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Volume 69e1e352-98bc-4501-bd9a-8439ef5aff0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d', 'volume_size': 2} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1318692884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e1e352-98bc-4501-bd9a-8439ef5aff0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91025c8886bb4c57b2e7335660fac176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:12:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:12:20Z,use_quota=True,user_id='8a20ad4bad06426f8aee0055220b05a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Creating volume 69e1e352-98bc-4501-bd9a-8439ef5aff0d {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:12:20 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:12:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d 2147483648 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:20 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=47, name=volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:12:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d 2147483648" returned: 0 in 0.756s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d" returned: 0 in 0.118s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] <== create_volume: return (948ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:12:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:12:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c21f2f3f-1bd5-4094-aebb-bc4e1ae5dca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d', 'volume_size': 2}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:12:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79fa1439-0bd7-403a-aa5f-3b59b8ca16c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:12:21 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Volume volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d (69e1e352-98bc-4501-bd9a-8439ef5aff0d): created successfully Sep 22 11:12:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79fa1439-0bd7-403a-aa5f-3b59b8ca16c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:12:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Flow 'volume_create_manager' (c6fcb76c-786a-43c5-af7a-5c3de5bba925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:12:21 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-a8012c37-aecf-477a-8483-943cb8ebe6f7 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Created volume successfully. Sep 22 11:12:22 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:12:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:12:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:12:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Creating offline snapshot 5999d4e3-a224-4cab-a902-2ce5f4cd6e8b of volume 69e1e352-98bc-4501-bd9a-8439ef5aff0d {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:12:22 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c741b627-f1ba-47de-921d-2cbb81ff8141]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:12:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d" returned: 0 in 0.452s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.5999d4e3-a224-4cab-a902-2ce5f4cd6e8b 2G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:23 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=48, name=volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.5999d4e3-a224-4cab-a902-2ce5f4cd6e8b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:12:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.5999d4e3-a224-4cab-a902-2ce5f4cd6e8b 2G" returned: 0 in 0.453s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Running cmd (subprocess): qemu-img rebase -u -b volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.5999d4e3-a224-4cab-a902-2ce5f4cd6e8b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] CMD "qemu-img rebase -u -b volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.5999d4e3-a224-4cab-a902-2ce5f4cd6e8b" returned: 0 in 0.187s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.5999d4e3-a224-4cab-a902-2ce5f4cd6e8b is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:12:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.5999d4e3-a224-4cab-a902-2ce5f4cd6e8b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.5999d4e3-a224-4cab-a902-2ce5f4cd6e8b" returned: 0 in 0.091s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:12:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.5999d4e3-a224-4cab-a902-2ce5f4cd6e8b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.5999d4e3-a224-4cab-a902-2ce5f4cd6e8b" returned: 0 in 0.123s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.info" returned: 0 in 0.109s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:12:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.info" returned: 0 in 0.100s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:12:25 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-223cc550-b9a7-4b2e-9bea-274d91b3d58c tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Create snapshot completed successfully Sep 22 11:12:26 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Acquiring lock "cinder-5999d4e3-a224-4cab-a902-2ce5f4cd6e8b-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:12:26 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Lock "cinder-5999d4e3-a224-4cab-a902-2ce5f4cd6e8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:12:26 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:12:26 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Acquiring lock "cinder-quobyte-69e1e352-98bc-4501-bd9a-8439ef5aff0d" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:12:26 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Lock "cinder-quobyte-69e1e352-98bc-4501-bd9a-8439ef5aff0d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:12:26 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Acquiring lock "cinder-quobyte-5999d4e3-a224-4cab-a902-2ce5f4cd6e8b" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:12:26 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Lock "cinder-quobyte-5999d4e3-a224-4cab-a902-2ce5f4cd6e8b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:12:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Deleting offline snapshot 5999d4e3-a224-4cab-a902-2ce5f4cd6e8b of volume 69e1e352-98bc-4501-bd9a-8439ef5aff0d {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:12:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] snapshot_file for this snap is: volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.5999d4e3-a224-4cab-a902-2ce5f4cd6e8b {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:12:26 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9094711c-bdcc-4142-bdff-3b90545438f5]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:12:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.5999d4e3-a224-4cab-a902-2ce5f4cd6e8b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:26 devstack quobyte-client[83313]: System call of process 90381 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:12:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.5999d4e3-a224-4cab-a902-2ce5f4cd6e8b" returned: 0 in 0.577s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:12:26 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[be638c9d-31de-4ae6-8a66-21b099700a2e]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:12:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d" returned: 0 in 0.714s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.5999d4e3-a224-4cab-a902-2ce5f4cd6e8b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:27 devstack quobyte-client[83313]: System call of process 90388 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:12:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.5999d4e3-a224-4cab-a902-2ce5f4cd6e8b" returned: 0 in 0.200s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.5999d4e3-a224-4cab-a902-2ce5f4cd6e8b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d.5999d4e3-a224-4cab-a902-2ce5f4cd6e8b" returned: 0 in 0.140s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:28 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Lock "cinder-quobyte-5999d4e3-a224-4cab-a902-2ce5f4cd6e8b" released by "_delete_snapshot" :: held 2.117s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:12:28 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Lock "cinder-quobyte-69e1e352-98bc-4501-bd9a-8439ef5aff0d" released by "delete_snapshot" :: held 2.152s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:12:28 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Created reservations ['dde045f4-e3a1-48ea-a70b-778c25bea0ec', '445ba62b-220d-4811-8792-8383f1615991', '3eb876a7-c50b-4b38-a38c-95ef1947d621', 'd39ef220-2530-4d4f-8f8d-a3880d200f63'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:12:28 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Delete snapshot completed successfully. Sep 22 11:12:28 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b8affa4d-ef47-484e-9105-b8e601b36b26 tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Lock "cinder-5999d4e3-a224-4cab-a902-2ce5f4cd6e8b-delete_snapshot" released by "delete_snapshot" :: held 2.777s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:12:29 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Acquiring lock "cinder-69e1e352-98bc-4501-bd9a-8439ef5aff0d-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:12:29 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Lock "cinder-69e1e352-98bc-4501-bd9a-8439ef5aff0d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:12:29 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:12:29 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Acquiring lock "cinder-quobyte-69e1e352-98bc-4501-bd9a-8439ef5aff0d" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:12:29 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Lock "cinder-quobyte-69e1e352-98bc-4501-bd9a-8439ef5aff0d" acquired by "delete_volume" :: waited 0.019s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:12:29 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b46be5-97ed-44eb-8890-58b5f3e39c06]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:12:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:30 devstack quobyte-client[83313]: System call of process 90393 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:12:30 devstack quobyte-client[83313]: System call of process 90393 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:12:30 devstack quobyte-client[83313]: System call of process 90393 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:12:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d" returned: 0 in 0.629s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-69e1e352-98bc-4501-bd9a-8439ef5aff0d" returned: 0 in 0.536s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Lock "cinder-quobyte-69e1e352-98bc-4501-bd9a-8439ef5aff0d" released by "delete_volume" :: held 1.641s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:12:32 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Created reservations ['0aa90597-cc15-4441-9100-eb4f9cf2954e', '29bb8134-601b-426b-b748-93ea55105e8b', '3a72223e-f7d9-4fe7-a689-79f12090382d', '588be7b8-af47-4a24-9c14-7751860d3d02'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:12:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:12:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:12:32 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:12:32 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:12:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:12:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:12:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.238s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:12:33 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:12:33 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Deleted volume successfully. Sep 22 11:12:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9144bad7-8d26-408c-9b04-c7e5a1f4c15e tempest-VolumesSnapshotNegativeTestJSON-1605226504 None] Lock "cinder-69e1e352-98bc-4501-bd9a-8439ef5aff0d-delete_volume" released by "delete_volume" :: held 4.477s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:12:42 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:DELETE=3,cinder:SELECT=29,cinder:UPDATE=42,cinder:INSERT=15 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:12:43 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=13,cinder:SELECT=11,cinder:DELETE=2,cinder:INSERT=5 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:13:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:13:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:13:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:13:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:13:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:13:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.066s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:13:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:13:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.188s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:13:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:13:42 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] Acquiring lock "cinder-871b7dd2-a3be-4962-a051-fe165ec49acc-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:13:42 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "cinder-871b7dd2-a3be-4962-a051-fe165ec49acc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:13:43 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:13:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] Acquiring lock "cinder-quobyte-871b7dd2-a3be-4962-a051-fe165ec49acc" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:13:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "cinder-quobyte-871b7dd2-a3be-4962-a051-fe165ec49acc" acquired by "delete_volume" :: waited 0.010s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:13:43 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5f0f76-0859-42cb-87d0-09e0e32a7766]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:13:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-871b7dd2-a3be-4962-a051-fe165ec49acc {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:13:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-871b7dd2-a3be-4962-a051-fe165ec49acc" returned: 0 in 0.529s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:13:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-871b7dd2-a3be-4962-a051-fe165ec49acc {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:13:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-871b7dd2-a3be-4962-a051-fe165ec49acc" returned: 0 in 0.085s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:13:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "cinder-quobyte-871b7dd2-a3be-4962-a051-fe165ec49acc" released by "delete_volume" :: held 0.780s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:13:44 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] Created reservations ['99df4c51-160b-4ff9-96fb-f885a612f22d', 'b2d195c9-d769-49b4-9651-1b6d6e1797e1', '03f83f1b-9c42-4a63-93f4-a816b18d0080', 'fab4a695-130c-4f62-8542-736319ab22a7'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:13:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:13:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:13:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:13:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:13:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:13:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:13:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.091s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:13:44 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:13:44 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] Deleted volume successfully. Sep 22 11:13:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f0904257-0f72-4495-93a6-319e6531aa3a tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "cinder-871b7dd2-a3be-4962-a051-fe165ec49acc-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:13:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] Acquiring lock "cinder-e0fba2ae-eeb5-4b79-8d43-952d4842826b-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:13:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "cinder-e0fba2ae-eeb5-4b79-8d43-952d4842826b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:13:45 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:13:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] Acquiring lock "cinder-quobyte-e0fba2ae-eeb5-4b79-8d43-952d4842826b" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:13:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "cinder-quobyte-e0fba2ae-eeb5-4b79-8d43-952d4842826b" acquired by "delete_volume" :: waited 0.025s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:13:45 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce59989-59e1-4892-a8b2-75098e52636c]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:13:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e0fba2ae-eeb5-4b79-8d43-952d4842826b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:13:46 devstack quobyte-client[83313]: System call of process 90685 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:13:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e0fba2ae-eeb5-4b79-8d43-952d4842826b" returned: 0 in 0.635s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:13:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e0fba2ae-eeb5-4b79-8d43-952d4842826b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:13:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e0fba2ae-eeb5-4b79-8d43-952d4842826b" returned: 0 in 0.142s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:13:46 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "cinder-quobyte-e0fba2ae-eeb5-4b79-8d43-952d4842826b" released by "delete_volume" :: held 1.089s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:13:47 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] Created reservations ['724f014b-222d-4092-b818-cf0f9b676908', '7a42d60b-c593-4811-b80c-2107bd47d9f0', 'd2edc316-91c4-4543-a2a3-8cf6f65ac25a', '8696fce4-9d91-4f96-b3b1-701c33e34f13'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:13:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:13:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:13:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:13:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:13:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:13:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:13:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.152s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:13:47 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:13:47 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] Deleted volume successfully. Sep 22 11:13:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b7b33493-4971-4471-b05e-058a6b821aef tempest-AttachVolumeShelveTestJSON-1546792471 None] Lock "cinder-e0fba2ae-eeb5-4b79-8d43-952d4842826b-delete_volume" released by "delete_volume" :: held 2.635s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:13:57 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=21,cinder:SELECT=6,cinder:INSERT=4 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:13:58 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=14,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=4 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:14:02 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Flow 'volume_create_manager' (a0cde54b-c122-4e64-92fa-97361b9b8147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e525efc3-c3fd-4079-a9ab-5ef740e18bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e525efc3-c3fd-4079-a9ab-5ef740e18bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1191552417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a1c556-2dbf-405e-af30-69cbb3f3272b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f20a4480d81b4a1ba92a845e9d24becf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:14:02Z,use_quota=True,user_id='3d9473dee96a4833b0431b3fbb21ba26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fd582c-48a2-414f-84ed-891073bddee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fd582c-48a2-414f-84ed-891073bddee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc4ffe9-ef97-4fc6-89d8-be0015f40b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc4ffe9-ef97-4fc6-89d8-be0015f40b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76a1c556-2dbf-405e-af30-69cbb3f3272b', 'volume_name': 'volume-76a1c556-2dbf-405e-af30-69cbb3f3272b', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ad15e4-bede-4d99-8b33-088f5be0ec3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ad15e4-bede-4d99-8b33-088f5be0ec3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60474bfe-dfdc-4e8f-b2af-26e3f626005e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:14:02 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Volume 76a1c556-2dbf-405e-af30-69cbb3f3272b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76a1c556-2dbf-405e-af30-69cbb3f3272b', 'volume_size': 1} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1191552417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a1c556-2dbf-405e-af30-69cbb3f3272b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f20a4480d81b4a1ba92a845e9d24becf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:14:02Z,use_quota=True,user_id='3d9473dee96a4833b0431b3fbb21ba26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Creating volume 76a1c556-2dbf-405e-af30-69cbb3f3272b {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:14:02 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:14:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-76a1c556-2dbf-405e-af30-69cbb3f3272b 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:14:03 devstack quobyte-client[83313]: System call of process 90797 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:14:03 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=50, name=volume-76a1c556-2dbf-405e-af30-69cbb3f3272b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:14:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-76a1c556-2dbf-405e-af30-69cbb3f3272b 1073741824" returned: 0 in 0.981s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:14:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-76a1c556-2dbf-405e-af30-69cbb3f3272b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:14:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-76a1c556-2dbf-405e-af30-69cbb3f3272b" returned: 0 in 0.367s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:14:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] <== create_volume: return (1647ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:14:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60474bfe-dfdc-4e8f-b2af-26e3f626005e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76a1c556-2dbf-405e-af30-69cbb3f3272b', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260150b6-4012-4c64-bcab-f05c062506c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:14:05 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Flow 'volume_create_manager' (ec9edea9-bdc4-45d5-a9e1-dc04798a913a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa78df7-176d-4f65-8a0e-acffd0396fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:14:05 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Volume volume-76a1c556-2dbf-405e-af30-69cbb3f3272b (76a1c556-2dbf-405e-af30-69cbb3f3272b): created successfully Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260150b6-4012-4c64-bcab-f05c062506c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Flow 'volume_create_manager' (a0cde54b-c122-4e64-92fa-97361b9b8147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa78df7-176d-4f65-8a0e-acffd0396fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1568886219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acca579f-7c48-449e-b1ff-32f894afbcc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e35c0322394addbb18d83582a85c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:14:04Z,use_quota=True,user_id='24d0cc189006423cb69c38f29cfcee4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda55f7e-43f7-41c0-b7e9-2264b1828de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda55f7e-43f7-41c0-b7e9-2264b1828de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93d2d15-6f48-4658-8c30-b9bfe8389092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93d2d15-6f48-4658-8c30-b9bfe8389092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acca579f-7c48-449e-b1ff-32f894afbcc0', 'volume_name': 'volume-acca579f-7c48-449e-b1ff-32f894afbcc0', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f9b28a-c72e-473e-b65d-8528f9e3374e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f9b28a-c72e-473e-b65d-8528f9e3374e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec21265-7932-4424-855e-c078c118eaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:14:05 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Volume acca579f-7c48-449e-b1ff-32f894afbcc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acca579f-7c48-449e-b1ff-32f894afbcc0', 'volume_size': 1} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1568886219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acca579f-7c48-449e-b1ff-32f894afbcc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e35c0322394addbb18d83582a85c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:14:04Z,use_quota=True,user_id='24d0cc189006423cb69c38f29cfcee4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Creating volume acca579f-7c48-449e-b1ff-32f894afbcc0 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:14:05 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:14:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-acca579f-7c48-449e-b1ff-32f894afbcc0 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:14:05 devstack quobyte-client[83313]: System call of process 90801 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:14:05 devstack quobyte-client[83313]: System call of process 90801 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:14:05 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=51, name=volume-acca579f-7c48-449e-b1ff-32f894afbcc0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:14:06 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-ece2156d-56c6-4cbb-b4a4-c29f38368381 tempest-TestMinimumBasicScenario-1767541253 None] Created volume successfully. Sep 22 11:14:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-acca579f-7c48-449e-b1ff-32f894afbcc0 1073741824" returned: 0 in 1.317s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:14:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-acca579f-7c48-449e-b1ff-32f894afbcc0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:14:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-acca579f-7c48-449e-b1ff-32f894afbcc0" returned: 0 in 0.280s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:14:07 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] <== create_volume: return (1723ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:14:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:14:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec21265-7932-4424-855e-c078c118eaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acca579f-7c48-449e-b1ff-32f894afbcc0', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:14:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08da1b8-9ac5-46f3-b423-5ebbf91b6db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:14:07 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Volume volume-acca579f-7c48-449e-b1ff-32f894afbcc0 (acca579f-7c48-449e-b1ff-32f894afbcc0): created successfully Sep 22 11:14:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08da1b8-9ac5-46f3-b423-5ebbf91b6db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:14:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Flow 'volume_create_manager' (ec9edea9-bdc4-45d5-a9e1-dc04798a913a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:14:07 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-7a7b872d-1ea0-4839-928b-c8c7358b67d3 tempest-AttachVolumeTestJSON-1827572322 None] Created volume successfully. Sep 22 11:14:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-78acd64a-7a8f-4934-8753-7f9d69dd4241 req-eabe77dd-90a6-450d-899b-d6c9877447ee tempest-TestMinimumBasicScenario-1767541253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:14:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-78acd64a-7a8f-4934-8753-7f9d69dd4241 req-eabe77dd-90a6-450d-899b-d6c9877447ee tempest-TestMinimumBasicScenario-1767541253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:14:11 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4581fd77-ad72-4c23-bbd9-5d5120ce1c59]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:14:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-78acd64a-7a8f-4934-8753-7f9d69dd4241 req-eabe77dd-90a6-450d-899b-d6c9877447ee tempest-TestMinimumBasicScenario-1767541253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-76a1c556-2dbf-405e-af30-69cbb3f3272b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:14:12 devstack quobyte-client[83313]: System call of process 90813 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:14:12 devstack quobyte-client[83313]: System call of process 90813 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:14:12 devstack quobyte-client[83313]: System call of process 90813 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:14:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-78acd64a-7a8f-4934-8753-7f9d69dd4241 req-eabe77dd-90a6-450d-899b-d6c9877447ee tempest-TestMinimumBasicScenario-1767541253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-76a1c556-2dbf-405e-af30-69cbb3f3272b" returned: 0 in 1.404s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:14:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-78acd64a-7a8f-4934-8753-7f9d69dd4241 req-eabe77dd-90a6-450d-899b-d6c9877447ee tempest-TestMinimumBasicScenario-1767541253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.583s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:14:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-78acd64a-7a8f-4934-8753-7f9d69dd4241 req-eabe77dd-90a6-450d-899b-d6c9877447ee tempest-TestMinimumBasicScenario-1767541253 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-76a1c556-2dbf-405e-af30-69cbb3f3272b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ddf85de-f31a-4bc2-9e8c-f865047bb383', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:14:13 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-78acd64a-7a8f-4934-8753-7f9d69dd4241 req-eabe77dd-90a6-450d-899b-d6c9877447ee tempest-TestMinimumBasicScenario-1767541253 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:14:14 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-78acd64a-7a8f-4934-8753-7f9d69dd4241 req-eabe77dd-90a6-450d-899b-d6c9877447ee tempest-TestMinimumBasicScenario-1767541253 None] attachment_update completed successfully. Sep 22 11:14:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-f6b3123e-0a15-4226-bbe7-89f4827e1b99 req-df6e742f-6d74-4aa0-aa15-d64a8de97f04 tempest-AttachVolumeTestJSON-1827572322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:14:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-f6b3123e-0a15-4226-bbe7-89f4827e1b99 req-df6e742f-6d74-4aa0-aa15-d64a8de97f04 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:14:14 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[1373925e-a413-4d44-9c17-47293a00ef7e]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:14:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-f6b3123e-0a15-4226-bbe7-89f4827e1b99 req-df6e742f-6d74-4aa0-aa15-d64a8de97f04 tempest-AttachVolumeTestJSON-1827572322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-acca579f-7c48-449e-b1ff-32f894afbcc0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:14:16 devstack quobyte-client[83313]: System call of process 90826 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:14:16 devstack quobyte-client[83313]: System call of process 90826 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:14:16 devstack quobyte-client[83313]: System call of process 90826 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:14:16 devstack quobyte-client[83313]: System call of process 90826 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:14:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-f6b3123e-0a15-4226-bbe7-89f4827e1b99 req-df6e742f-6d74-4aa0-aa15-d64a8de97f04 tempest-AttachVolumeTestJSON-1827572322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-acca579f-7c48-449e-b1ff-32f894afbcc0" returned: 0 in 1.550s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:14:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-f6b3123e-0a15-4226-bbe7-89f4827e1b99 req-df6e742f-6d74-4aa0-aa15-d64a8de97f04 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.632s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:14:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-f6b3123e-0a15-4226-bbe7-89f4827e1b99 req-df6e742f-6d74-4aa0-aa15-d64a8de97f04 tempest-AttachVolumeTestJSON-1827572322 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-acca579f-7c48-449e-b1ff-32f894afbcc0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '107ea406-658b-45aa-a937-0fcebb9fc522', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:14:16 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-f6b3123e-0a15-4226-bbe7-89f4827e1b99 req-df6e742f-6d74-4aa0-aa15-d64a8de97f04 tempest-AttachVolumeTestJSON-1827572322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:14:17 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-f6b3123e-0a15-4226-bbe7-89f4827e1b99 req-df6e742f-6d74-4aa0-aa15-d64a8de97f04 tempest-AttachVolumeTestJSON-1827572322 None] attachment_update completed successfully. Sep 22 11:14:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:14:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:14:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:14:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:14:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:14:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.071s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:14:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:14:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.339s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:14:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:14:25 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:14:25 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Flow 'volume_create_manager' (e5e7c5e6-c3c1-435d-ad95-1cea4adbd202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b709739-5978-45cd-98cf-e3fc3ce05e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b709739-5978-45cd-98cf-e3fc3ce05e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-230305920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03002556-951c-4a20-9431-7baf7485c565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e35c0322394addbb18d83582a85c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:14:25Z,use_quota=True,user_id='24d0cc189006423cb69c38f29cfcee4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d89d139-aada-498e-839c-27cd48641300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d89d139-aada-498e-839c-27cd48641300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53abbbab-7a52-4faa-8214-15b1e1979023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53abbbab-7a52-4faa-8214-15b1e1979023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03002556-951c-4a20-9431-7baf7485c565', 'volume_name': 'volume-03002556-951c-4a20-9431-7baf7485c565', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a09f9b-4dbf-41c3-9c7f-1916b50d0deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a09f9b-4dbf-41c3-9c7f-1916b50d0deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bfd538-e26d-47ce-8ce1-27453c8aeca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:14:26 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Volume 03002556-951c-4a20-9431-7baf7485c565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03002556-951c-4a20-9431-7baf7485c565', 'volume_size': 1} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-230305920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03002556-951c-4a20-9431-7baf7485c565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e35c0322394addbb18d83582a85c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:14:25Z,use_quota=True,user_id='24d0cc189006423cb69c38f29cfcee4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Creating volume 03002556-951c-4a20-9431-7baf7485c565 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:14:26 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:14:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-03002556-951c-4a20-9431-7baf7485c565 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:14:26 devstack quobyte-client[83313]: System call of process 91263 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:14:26 devstack quobyte-client[83313]: System call of process 91263 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:14:26 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=52, name=volume-03002556-951c-4a20-9431-7baf7485c565, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:14:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-03002556-951c-4a20-9431-7baf7485c565 1073741824" returned: 0 in 0.819s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:14:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-03002556-951c-4a20-9431-7baf7485c565 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:14:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-03002556-951c-4a20-9431-7baf7485c565" returned: 0 in 0.468s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:14:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] <== create_volume: return (1488ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:14:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:14:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bfd538-e26d-47ce-8ce1-27453c8aeca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03002556-951c-4a20-9431-7baf7485c565', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:14:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d627cab0-aeb3-48d7-9ca6-0b5354ff2ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:14:28 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Volume volume-03002556-951c-4a20-9431-7baf7485c565 (03002556-951c-4a20-9431-7baf7485c565): created successfully Sep 22 11:14:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d627cab0-aeb3-48d7-9ca6-0b5354ff2ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:14:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Flow 'volume_create_manager' (e5e7c5e6-c3c1-435d-ad95-1cea4adbd202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:14:28 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-8e30444d-d53e-4cc8-a053-cc3b779b02e2 tempest-AttachVolumeTestJSON-1827572322 None] Created volume successfully. Sep 22 11:14:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-0459b0eb-2066-4f6a-8ba3-651039e4835a req-245ba88a-83e1-4744-ac9f-eb18c8b1d780 tempest-AttachVolumeTestJSON-1827572322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:14:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-0459b0eb-2066-4f6a-8ba3-651039e4835a req-245ba88a-83e1-4744-ac9f-eb18c8b1d780 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:14:36 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72f9be1-cb1a-4745-81c5-916dc6456a64]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:14:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-0459b0eb-2066-4f6a-8ba3-651039e4835a req-245ba88a-83e1-4744-ac9f-eb18c8b1d780 tempest-AttachVolumeTestJSON-1827572322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-03002556-951c-4a20-9431-7baf7485c565 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:14:37 devstack quobyte-client[83313]: System call of process 91368 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:14:37 devstack quobyte-client[83313]: System call of process 91368 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:14:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-0459b0eb-2066-4f6a-8ba3-651039e4835a req-245ba88a-83e1-4744-ac9f-eb18c8b1d780 tempest-AttachVolumeTestJSON-1827572322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-03002556-951c-4a20-9431-7baf7485c565" returned: 0 in 0.949s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:14:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-0459b0eb-2066-4f6a-8ba3-651039e4835a req-245ba88a-83e1-4744-ac9f-eb18c8b1d780 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.032s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:14:38 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-0459b0eb-2066-4f6a-8ba3-651039e4835a req-245ba88a-83e1-4744-ac9f-eb18c8b1d780 tempest-AttachVolumeTestJSON-1827572322 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-03002556-951c-4a20-9431-7baf7485c565', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20a2681c-2866-4fe8-8564-0380aa5fb3ab', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:14:38 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-0459b0eb-2066-4f6a-8ba3-651039e4835a req-245ba88a-83e1-4744-ac9f-eb18c8b1d780 tempest-AttachVolumeTestJSON-1827572322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:14:38 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-0459b0eb-2066-4f6a-8ba3-651039e4835a req-245ba88a-83e1-4744-ac9f-eb18c8b1d780 tempest-AttachVolumeTestJSON-1827572322 None] attachment_update completed successfully. Sep 22 11:14:48 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=13,cinder:SELECT=17,cinder:DELETE=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:14:48 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=23,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:15:08 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-8e366d89-4fea-41b4-8aff-c9c8a7df6548 req-fc335e68-36de-44f5-bdab-0c42fda8beb9 tempest-AttachVolumeTestJSON-1827572322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:15:08 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-8e366d89-4fea-41b4-8aff-c9c8a7df6548 req-fc335e68-36de-44f5-bdab-0c42fda8beb9 tempest-AttachVolumeTestJSON-1827572322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:15:08 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-8e366d89-4fea-41b4-8aff-c9c8a7df6548 req-fc335e68-36de-44f5-bdab-0c42fda8beb9 tempest-AttachVolumeTestJSON-1827572322 None] Terminate volume connection completed successfully. Sep 22 11:15:08 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-8e366d89-4fea-41b4-8aff-c9c8a7df6548 req-fc335e68-36de-44f5-bdab-0c42fda8beb9 tempest-AttachVolumeTestJSON-1827572322 None] Deleting attachment 107ea406-658b-45aa-a937-0fcebb9fc522. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:15:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:15:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:15:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:15:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:15:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:15:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.139s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:15:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:15:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.502s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:15:18 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:15:18 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:15:18 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:15:33 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-08ea7cfe-bc58-4c4e-a2b7-2985ca86fe3c req-e5e40160-3883-451d-867a-43a76d133135 tempest-AttachVolumeTestJSON-1827572322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:15:34 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-08ea7cfe-bc58-4c4e-a2b7-2985ca86fe3c req-e5e40160-3883-451d-867a-43a76d133135 tempest-AttachVolumeTestJSON-1827572322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:15:34 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-08ea7cfe-bc58-4c4e-a2b7-2985ca86fe3c req-e5e40160-3883-451d-867a-43a76d133135 tempest-AttachVolumeTestJSON-1827572322 None] Terminate volume connection completed successfully. Sep 22 11:15:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-08ea7cfe-bc58-4c4e-a2b7-2985ca86fe3c req-e5e40160-3883-451d-867a-43a76d133135 tempest-AttachVolumeTestJSON-1827572322 None] Deleting attachment 20a2681c-2866-4fe8-8564-0380aa5fb3ab. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:15:44 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:15:44 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:15:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] Acquiring lock "cinder-03002556-951c-4a20-9431-7baf7485c565-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:15:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] Lock "cinder-03002556-951c-4a20-9431-7baf7485c565-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:15:50 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:15:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] Acquiring lock "cinder-quobyte-03002556-951c-4a20-9431-7baf7485c565" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:15:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] Lock "cinder-quobyte-03002556-951c-4a20-9431-7baf7485c565" acquired by "delete_volume" :: waited 0.019s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:15:50 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3c0ba1-eb01-4527-9b84-d1b505e52475]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:15:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-03002556-951c-4a20-9431-7baf7485c565 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:15:50 devstack quobyte-client[83313]: System call of process 91752 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:15:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-03002556-951c-4a20-9431-7baf7485c565" returned: 0 in 0.446s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:15:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-03002556-951c-4a20-9431-7baf7485c565 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:15:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-03002556-951c-4a20-9431-7baf7485c565" returned: 0 in 0.119s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:15:51 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] Lock "cinder-quobyte-03002556-951c-4a20-9431-7baf7485c565" released by "delete_volume" :: held 0.801s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:15:51 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] Created reservations ['daea78b1-12a3-4dbd-9632-56715b18d464', '951a5b6f-7189-4901-85be-5805565e6afa', 'd243d7c5-b820-4125-b8d6-9e7f21e44959', 'a20eb066-3deb-4439-8a06-41efab0ed218'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:15:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:15:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:15:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:15:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:15:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:15:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:15:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.090s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:15:51 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:15:51 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] Deleted volume successfully. Sep 22 11:15:52 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d40d2dd2-d299-4d14-81d9-9148c241ac53 tempest-AttachVolumeTestJSON-1827572322 None] Lock "cinder-03002556-951c-4a20-9431-7baf7485c565-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:15:52 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] Acquiring lock "cinder-acca579f-7c48-449e-b1ff-32f894afbcc0-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:15:52 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] Lock "cinder-acca579f-7c48-449e-b1ff-32f894afbcc0-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:15:53 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:15:53 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] Acquiring lock "cinder-quobyte-acca579f-7c48-449e-b1ff-32f894afbcc0" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:15:53 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] Lock "cinder-quobyte-acca579f-7c48-449e-b1ff-32f894afbcc0" acquired by "delete_volume" :: waited 0.011s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:15:53 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f42cbc-9ed6-4b0b-885e-36c9b7a77be3]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:15:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-acca579f-7c48-449e-b1ff-32f894afbcc0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:15:53 devstack quobyte-client[83313]: System call of process 91758 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:15:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-acca579f-7c48-449e-b1ff-32f894afbcc0" returned: 0 in 0.557s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:15:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-acca579f-7c48-449e-b1ff-32f894afbcc0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:15:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-acca579f-7c48-449e-b1ff-32f894afbcc0" returned: 0 in 0.177s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:15:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] Lock "cinder-quobyte-acca579f-7c48-449e-b1ff-32f894afbcc0" released by "delete_volume" :: held 1.017s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:15:54 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] Created reservations ['979eb0b8-2a46-458c-bff2-0840d63e0ead', '0789283c-3ae9-4b15-94e3-9a7cb1613dde', 'c43fdaf5-a940-473d-a8fe-9dd70fafc4e5', '1de894bf-08c9-4da0-8d9c-e10187b510dd'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:15:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:15:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:15:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:15:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:15:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:15:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:15:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.139s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:15:54 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:15:54 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] Deleted volume successfully. Sep 22 11:15:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-de7e4705-1298-4e5b-94d9-74815c8607f2 tempest-AttachVolumeTestJSON-1827572322 None] Lock "cinder-acca579f-7c48-449e-b1ff-32f894afbcc0-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:15:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] Acquiring lock "cinder-b8c9e5ef-9100-42db-a0c6-a8ed11a28598-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:15:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] Lock "cinder-b8c9e5ef-9100-42db-a0c6-a8ed11a28598-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:15:55 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:15:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] Acquiring lock "cinder-quobyte-b8c9e5ef-9100-42db-a0c6-a8ed11a28598" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:15:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] Lock "cinder-quobyte-b8c9e5ef-9100-42db-a0c6-a8ed11a28598" acquired by "delete_volume" :: waited 0.016s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:15:55 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b14c40e-7682-4c6e-b505-37bb03a11dfe]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:15:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b8c9e5ef-9100-42db-a0c6-a8ed11a28598 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:15:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b8c9e5ef-9100-42db-a0c6-a8ed11a28598" returned: 0 in 0.546s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:15:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b8c9e5ef-9100-42db-a0c6-a8ed11a28598 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:15:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b8c9e5ef-9100-42db-a0c6-a8ed11a28598" returned: 0 in 0.151s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:15:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] Lock "cinder-quobyte-b8c9e5ef-9100-42db-a0c6-a8ed11a28598" released by "delete_volume" :: held 0.985s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:15:57 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] Created reservations ['e8ee0d14-ca56-4f26-8feb-c4fbd568679a', '58a226a2-dcc0-4271-a374-52a4d9475719', '9f153e3c-27e4-4105-9047-7b03a4e05673', 'd5e3f002-b434-47ab-998a-a67613bb1b9b'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:15:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:15:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:15:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:15:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:15:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:15:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:15:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.169s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:15:57 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:15:57 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] Deleted volume successfully. Sep 22 11:15:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-edd268dd-da9d-407f-94d4-b855c335a1a4 tempest-AttachVolumeTestJSON-1827572322 None] Lock "cinder-b8c9e5ef-9100-42db-a0c6-a8ed11a28598-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:16:08 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=15,cinder:INSERT=1,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:16:08 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=16,cinder:SELECT=16,cinder:INSERT=11,cinder:DELETE=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:16:12 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:16:12 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Flow 'volume_create_manager' (852f3d52-a39b-4f01-bdb4-7dbf73cf4b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b667d2b9-58a1-499c-807e-34cc459825ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b667d2b9-58a1-499c-807e-34cc459825ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1457945099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4fec80-02f3-43fe-8c86-67bee366440b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839c8213b56a45ccb63853de8a29eed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:16:13Z,use_quota=True,user_id='d5d28ef8ea4a48b6bca56ef8ece2b2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25554310-7d4c-4c65-bd89-6caed5acf093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25554310-7d4c-4c65-bd89-6caed5acf093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2501ac6e-e91a-4e4d-8f03-2388073c9e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2501ac6e-e91a-4e4d-8f03-2388073c9e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b4fec80-02f3-43fe-8c86-67bee366440b', 'volume_name': 'volume-1b4fec80-02f3-43fe-8c86-67bee366440b', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2438d83b-ef62-4f27-af54-68f4eea85b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2438d83b-ef62-4f27-af54-68f4eea85b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26331e94-a11c-4f8b-a9c2-219aeb2ced70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:16:13 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Volume 1b4fec80-02f3-43fe-8c86-67bee366440b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b4fec80-02f3-43fe-8c86-67bee366440b', 'volume_size': 1} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1457945099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4fec80-02f3-43fe-8c86-67bee366440b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839c8213b56a45ccb63853de8a29eed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:16:13Z,use_quota=True,user_id='d5d28ef8ea4a48b6bca56ef8ece2b2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Creating volume 1b4fec80-02f3-43fe-8c86-67bee366440b {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:16:13 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1b4fec80-02f3-43fe-8c86-67bee366440b 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:13 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=53, name=volume-1b4fec80-02f3-43fe-8c86-67bee366440b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1b4fec80-02f3-43fe-8c86-67bee366440b 1073741824" returned: 0 in 0.515s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1b4fec80-02f3-43fe-8c86-67bee366440b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1b4fec80-02f3-43fe-8c86-67bee366440b" returned: 0 in 0.245s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:14 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] <== create_volume: return (907ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:16:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:16:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26331e94-a11c-4f8b-a9c2-219aeb2ced70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b4fec80-02f3-43fe-8c86-67bee366440b', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:16:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835ebd7b-892c-418f-8f54-5f917233d19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:16:14 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Volume volume-1b4fec80-02f3-43fe-8c86-67bee366440b (1b4fec80-02f3-43fe-8c86-67bee366440b): created successfully Sep 22 11:16:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835ebd7b-892c-418f-8f54-5f917233d19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:16:14 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Flow 'volume_create_manager' (852f3d52-a39b-4f01-bdb4-7dbf73cf4b37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:16:14 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-16c16244-2671-4cb6-b99c-8c6616c9f42f tempest-AttachVolumeNegativeTest-524744203 None] Created volume successfully. Sep 22 11:16:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:16:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:16:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:16:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:16:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:16:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:16:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.237s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:16:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-13659eab-5a43-4c6a-8879-872315595925 req-48f350ac-70a8-4681-a978-7506444ab844 tempest-AttachVolumeNegativeTest-524744203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:16:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-13659eab-5a43-4c6a-8879-872315595925 req-48f350ac-70a8-4681-a978-7506444ab844 tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:16:20 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77d6c7a-7ae1-4dd3-b1a5-0ed072ecf4f3]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:16:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-13659eab-5a43-4c6a-8879-872315595925 req-48f350ac-70a8-4681-a978-7506444ab844 tempest-AttachVolumeNegativeTest-524744203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1b4fec80-02f3-43fe-8c86-67bee366440b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:21 devstack quobyte-client[83313]: System call of process 91817 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-13659eab-5a43-4c6a-8879-872315595925 req-48f350ac-70a8-4681-a978-7506444ab844 tempest-AttachVolumeNegativeTest-524744203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1b4fec80-02f3-43fe-8c86-67bee366440b" returned: 0 in 0.876s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-13659eab-5a43-4c6a-8879-872315595925 req-48f350ac-70a8-4681-a978-7506444ab844 tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.982s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:16:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-13659eab-5a43-4c6a-8879-872315595925 req-48f350ac-70a8-4681-a978-7506444ab844 tempest-AttachVolumeNegativeTest-524744203 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-1b4fec80-02f3-43fe-8c86-67bee366440b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2e8bec3-6b94-49e8-b0f6-f3bddcef0cab', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:16:21 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-13659eab-5a43-4c6a-8879-872315595925 req-48f350ac-70a8-4681-a978-7506444ab844 tempest-AttachVolumeNegativeTest-524744203 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:16:21 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-13659eab-5a43-4c6a-8879-872315595925 req-48f350ac-70a8-4681-a978-7506444ab844 tempest-AttachVolumeNegativeTest-524744203 None] attachment_update completed successfully. Sep 22 11:16:28 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:16:28 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:16:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Flow 'volume_create_manager' (a280009a-b3b5-43bf-82f3-4ba7e5a3d2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:16:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d73a01-3082-4b05-9d2e-f712be2d42f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:16:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d73a01-3082-4b05-9d2e-f712be2d42f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-990365222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5af08a-0a79-4819-975a-eb1b96c97aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d153130d234e1ea0180f4584666d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:16:29Z,use_quota=True,user_id='567772c7969c486d8de0e1dff6f0d8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:16:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182b7cec-fb05-4829-b891-b2dc07f9502a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:16:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182b7cec-fb05-4829-b891-b2dc07f9502a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:16:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4c3ce44-8828-4e78-a620-f5be63954ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:16:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4c3ce44-8828-4e78-a620-f5be63954ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee5af08a-0a79-4819-975a-eb1b96c97aa7', 'volume_name': 'volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:16:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36f4d4a-7ce0-4c65-ac17-d6ba3e9555f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:16:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36f4d4a-7ce0-4c65-ac17-d6ba3e9555f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:16:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66037e4c-422b-47a3-b2ab-ab02d4e7a183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:16:29 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Volume ee5af08a-0a79-4819-975a-eb1b96c97aa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7', 'volume_size': 1} Sep 22 11:16:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:16:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:16:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-990365222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5af08a-0a79-4819-975a-eb1b96c97aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d153130d234e1ea0180f4584666d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:16:29Z,use_quota=True,user_id='567772c7969c486d8de0e1dff6f0d8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:16:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Creating volume ee5af08a-0a79-4819-975a-eb1b96c97aa7 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:16:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:16:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:16:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:16:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:16:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:16:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:16:29 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:16:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:29 devstack quobyte-client[83313]: System call of process 91882 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:29 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=54, name=volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:16:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7 1073741824" returned: 0 in 0.897s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7" returned: 0 in 0.191s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:30 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] <== create_volume: return (1427ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:16:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:16:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66037e4c-422b-47a3-b2ab-ab02d4e7a183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:16:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ba114d-b978-4525-a88b-ab62c3abf093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:16:31 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Volume volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7 (ee5af08a-0a79-4819-975a-eb1b96c97aa7): created successfully Sep 22 11:16:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ba114d-b978-4525-a88b-ab62c3abf093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:16:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Flow 'volume_create_manager' (a280009a-b3b5-43bf-82f3-4ba7e5a3d2d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:16:31 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-0c60f1e4-136b-407f-b02b-5fea263aef8e tempest-SnapshotsActionsTest-1885230975 None] Created volume successfully. Sep 22 11:16:32 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:16:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:16:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:16:33 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] Creating offline snapshot 162e95d0-596b-43ef-95b5-7f7e0fb24d81 of volume ee5af08a-0a79-4819-975a-eb1b96c97aa7 {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:16:33 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd0ea84-00dd-4e1a-9150-81635aa872d3]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:16:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:34 devstack quobyte-client[83313]: System call of process 91900 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:34 devstack quobyte-client[83313]: System call of process 91900 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7" returned: 0 in 1.199s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:34 devstack quobyte-client[83313]: System call of process 91903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:34 devstack quobyte-client[83313]: System call of process 91903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:34 devstack quobyte-client[83313]: System call of process 91903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:34 devstack quobyte-client[83313]: System call of process 91903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:34 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=55, name=volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:16:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 1G" returned: 0 in 0.480s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] CMD "qemu-img rebase -u -b volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81" returned: 0 in 0.269s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:16:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81" returned: 0 in 0.105s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7 -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:16:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81" returned: 0 in 0.143s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.info" returned: 0 in 0.135s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:16:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.info" returned: 0 in 0.168s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.447s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:16:36 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-e82dd2f9-9449-423c-a30e-2f012b929157 tempest-SnapshotsActionsTest-1885230975 None] Create snapshot completed successfully Sep 22 11:16:38 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-3dd44e08-fb92-4de8-bd21-ba0a66407db2 tempest-SnapshotsActionsTest-1885230975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:16:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3dd44e08-fb92-4de8-bd21-ba0a66407db2 tempest-SnapshotsActionsTest-1885230975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:16:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3dd44e08-fb92-4de8-bd21-ba0a66407db2 tempest-SnapshotsActionsTest-1885230975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:16:38 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3dd44e08-fb92-4de8-bd21-ba0a66407db2 tempest-SnapshotsActionsTest-1885230975 None] Creating offline snapshot f866ec1a-ac1b-48ce-a187-1a1c3305db25 of volume ee5af08a-0a79-4819-975a-eb1b96c97aa7 {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:16:38 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[50eb26c7-b91d-4e0e-bade-5a29a5f77b89]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:16:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3dd44e08-fb92-4de8-bd21-ba0a66407db2 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:39 devstack quobyte-client[83313]: System call of process 91916 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3dd44e08-fb92-4de8-bd21-ba0a66407db2 tempest-SnapshotsActionsTest-1885230975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81" returned: 0 in 0.942s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3dd44e08-fb92-4de8-bd21-ba0a66407db2 tempest-SnapshotsActionsTest-1885230975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:16:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3dd44e08-fb92-4de8-bd21-ba0a66407db2 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.f866ec1a-ac1b-48ce-a187-1a1c3305db25 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:39 devstack quobyte-client[83313]: System call of process 91919 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:39 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=57, name=volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.f866ec1a-ac1b-48ce-a187-1a1c3305db25, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:16:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3dd44e08-fb92-4de8-bd21-ba0a66407db2 tempest-SnapshotsActionsTest-1885230975 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.f866ec1a-ac1b-48ce-a187-1a1c3305db25 1G" returned: 0 in 0.557s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3dd44e08-fb92-4de8-bd21-ba0a66407db2 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.f866ec1a-ac1b-48ce-a187-1a1c3305db25 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:40 devstack quobyte-client[83313]: System call of process 91925 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:40 devstack quobyte-client[83313]: System call of process 91925 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:40 devstack quobyte-client[83313]: System call of process 91925 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3dd44e08-fb92-4de8-bd21-ba0a66407db2 tempest-SnapshotsActionsTest-1885230975 None] CMD "qemu-img rebase -u -b volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.f866ec1a-ac1b-48ce-a187-1a1c3305db25" returned: 0 in 0.191s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3dd44e08-fb92-4de8-bd21-ba0a66407db2 tempest-SnapshotsActionsTest-1885230975 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.f866ec1a-ac1b-48ce-a187-1a1c3305db25 is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:16:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3dd44e08-fb92-4de8-bd21-ba0a66407db2 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.f866ec1a-ac1b-48ce-a187-1a1c3305db25 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3dd44e08-fb92-4de8-bd21-ba0a66407db2 tempest-SnapshotsActionsTest-1885230975 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.f866ec1a-ac1b-48ce-a187-1a1c3305db25" returned: 0 in 0.156s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3dd44e08-fb92-4de8-bd21-ba0a66407db2 tempest-SnapshotsActionsTest-1885230975 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:16:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3dd44e08-fb92-4de8-bd21-ba0a66407db2 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.f866ec1a-ac1b-48ce-a187-1a1c3305db25 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3dd44e08-fb92-4de8-bd21-ba0a66407db2 tempest-SnapshotsActionsTest-1885230975 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.f866ec1a-ac1b-48ce-a187-1a1c3305db25" returned: 0 in 0.125s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3dd44e08-fb92-4de8-bd21-ba0a66407db2 tempest-SnapshotsActionsTest-1885230975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.447s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:16:40 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-3dd44e08-fb92-4de8-bd21-ba0a66407db2 tempest-SnapshotsActionsTest-1885230975 None] Create snapshot completed successfully Sep 22 11:16:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] Acquiring lock "cinder-f866ec1a-ac1b-48ce-a187-1a1c3305db25-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:16:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-f866ec1a-ac1b-48ce-a187-1a1c3305db25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:16:41 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:16:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] Acquiring lock "cinder-quobyte-ee5af08a-0a79-4819-975a-eb1b96c97aa7" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:16:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-quobyte-ee5af08a-0a79-4819-975a-eb1b96c97aa7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:16:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] Acquiring lock "cinder-quobyte-f866ec1a-ac1b-48ce-a187-1a1c3305db25" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:16:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-quobyte-f866ec1a-ac1b-48ce-a187-1a1c3305db25" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:16:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] Deleting offline snapshot f866ec1a-ac1b-48ce-a187-1a1c3305db25 of volume ee5af08a-0a79-4819-975a-eb1b96c97aa7 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:16:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] snapshot_file for this snap is: volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.f866ec1a-ac1b-48ce-a187-1a1c3305db25 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:16:41 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6e4abd-2dd9-4ba3-9a8f-16bff6bca135]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:16:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.f866ec1a-ac1b-48ce-a187-1a1c3305db25 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.f866ec1a-ac1b-48ce-a187-1a1c3305db25" returned: 0 in 0.646s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:42 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:16:42 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53b927b-5f36-444d-aa48-e7d4e5fa416a]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:16:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:43 devstack quobyte-client[83313]: System call of process 91940 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:43 devstack quobyte-client[83313]: System call of process 91940 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:43 devstack quobyte-client[83313]: System call of process 91940 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81" returned: 0 in 0.587s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:16:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.f866ec1a-ac1b-48ce-a187-1a1c3305db25 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.f866ec1a-ac1b-48ce-a187-1a1c3305db25" returned: 0 in 0.519s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.f866ec1a-ac1b-48ce-a187-1a1c3305db25 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.f866ec1a-ac1b-48ce-a187-1a1c3305db25" returned: 0 in 0.279s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-quobyte-f866ec1a-ac1b-48ce-a187-1a1c3305db25" released by "_delete_snapshot" :: held 2.566s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:16:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-quobyte-ee5af08a-0a79-4819-975a-eb1b96c97aa7" released by "delete_snapshot" :: held 2.614s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:16:45 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] Created reservations ['d42118a0-729d-4088-abfa-d418b97257c5', 'c906cc64-238e-49be-af36-0f4bf4e394b0', 'de072451-381c-49bc-b523-acad8afbfff4', 'f72664cc-f2d4-4fe3-b40a-e0ae74c846b7'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:16:45 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] Delete snapshot completed successfully. Sep 22 11:16:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cb6d172d-7742-4c4f-a83d-56b6a01b5da2 tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-f866ec1a-ac1b-48ce-a187-1a1c3305db25-delete_snapshot" released by "delete_snapshot" :: held 3.422s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:16:47 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-e37d0c1b-2e9d-4903-8dd5-5a0dc5306b4f tempest-SnapshotsActionsTest-1885230975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:16:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e37d0c1b-2e9d-4903-8dd5-5a0dc5306b4f tempest-SnapshotsActionsTest-1885230975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:16:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e37d0c1b-2e9d-4903-8dd5-5a0dc5306b4f tempest-SnapshotsActionsTest-1885230975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:16:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-e37d0c1b-2e9d-4903-8dd5-5a0dc5306b4f tempest-SnapshotsActionsTest-1885230975 None] Creating offline snapshot 1b041b05-b673-413f-babc-4897c6a02111 of volume ee5af08a-0a79-4819-975a-eb1b96c97aa7 {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:16:47 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49b8f27-9b6e-4cde-b148-b908096ead07]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:16:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e37d0c1b-2e9d-4903-8dd5-5a0dc5306b4f tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:47 devstack quobyte-client[83313]: System call of process 91963 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:47 devstack quobyte-client[83313]: System call of process 91963 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e37d0c1b-2e9d-4903-8dd5-5a0dc5306b4f tempest-SnapshotsActionsTest-1885230975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81" returned: 0 in 0.427s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-e37d0c1b-2e9d-4903-8dd5-5a0dc5306b4f tempest-SnapshotsActionsTest-1885230975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:16:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e37d0c1b-2e9d-4903-8dd5-5a0dc5306b4f tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.1b041b05-b673-413f-babc-4897c6a02111 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:47 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=58, name=volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.1b041b05-b673-413f-babc-4897c6a02111, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:16:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e37d0c1b-2e9d-4903-8dd5-5a0dc5306b4f tempest-SnapshotsActionsTest-1885230975 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.1b041b05-b673-413f-babc-4897c6a02111 1G" returned: 0 in 0.373s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e37d0c1b-2e9d-4903-8dd5-5a0dc5306b4f tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.1b041b05-b673-413f-babc-4897c6a02111 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e37d0c1b-2e9d-4903-8dd5-5a0dc5306b4f tempest-SnapshotsActionsTest-1885230975 None] CMD "qemu-img rebase -u -b volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.1b041b05-b673-413f-babc-4897c6a02111" returned: 0 in 0.136s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:48 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-e37d0c1b-2e9d-4903-8dd5-5a0dc5306b4f tempest-SnapshotsActionsTest-1885230975 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.1b041b05-b673-413f-babc-4897c6a02111 is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:16:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e37d0c1b-2e9d-4903-8dd5-5a0dc5306b4f tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.1b041b05-b673-413f-babc-4897c6a02111 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e37d0c1b-2e9d-4903-8dd5-5a0dc5306b4f tempest-SnapshotsActionsTest-1885230975 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.1b041b05-b673-413f-babc-4897c6a02111" returned: 0 in 0.108s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:48 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-e37d0c1b-2e9d-4903-8dd5-5a0dc5306b4f tempest-SnapshotsActionsTest-1885230975 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:16:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e37d0c1b-2e9d-4903-8dd5-5a0dc5306b4f tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.1b041b05-b673-413f-babc-4897c6a02111 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e37d0c1b-2e9d-4903-8dd5-5a0dc5306b4f tempest-SnapshotsActionsTest-1885230975 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.1b041b05-b673-413f-babc-4897c6a02111" returned: 0 in 0.134s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e37d0c1b-2e9d-4903-8dd5-5a0dc5306b4f tempest-SnapshotsActionsTest-1885230975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.513s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:16:48 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-e37d0c1b-2e9d-4903-8dd5-5a0dc5306b4f tempest-SnapshotsActionsTest-1885230975 None] Create snapshot completed successfully Sep 22 11:16:49 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] Acquiring lock "cinder-1b041b05-b673-413f-babc-4897c6a02111-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:16:49 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-1b041b05-b673-413f-babc-4897c6a02111-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:16:49 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:16:49 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] Acquiring lock "cinder-quobyte-ee5af08a-0a79-4819-975a-eb1b96c97aa7" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:16:49 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-quobyte-ee5af08a-0a79-4819-975a-eb1b96c97aa7" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:16:49 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] Acquiring lock "cinder-quobyte-1b041b05-b673-413f-babc-4897c6a02111" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:16:49 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-quobyte-1b041b05-b673-413f-babc-4897c6a02111" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:16:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] Deleting offline snapshot 1b041b05-b673-413f-babc-4897c6a02111 of volume ee5af08a-0a79-4819-975a-eb1b96c97aa7 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:16:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] snapshot_file for this snap is: volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.1b041b05-b673-413f-babc-4897c6a02111 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:16:49 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64a8c11-b87e-4530-9404-a50f5ce090b8]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:16:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.1b041b05-b673-413f-babc-4897c6a02111 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.1b041b05-b673-413f-babc-4897c6a02111" returned: 0 in 0.388s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:16:49 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8c84e9-a16c-4db9-8ec3-a6423a4bf5a9]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:16:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81" returned: 0 in 0.428s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:50 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:16:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.1b041b05-b673-413f-babc-4897c6a02111 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:50 devstack quobyte-client[83313]: System call of process 91986 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:50 devstack quobyte-client[83313]: System call of process 91986 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.1b041b05-b673-413f-babc-4897c6a02111" returned: 0 in 0.295s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.1b041b05-b673-413f-babc-4897c6a02111 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.1b041b05-b673-413f-babc-4897c6a02111" returned: 0 in 0.103s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-quobyte-1b041b05-b673-413f-babc-4897c6a02111" released by "_delete_snapshot" :: held 1.582s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:16:51 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-quobyte-ee5af08a-0a79-4819-975a-eb1b96c97aa7" released by "delete_snapshot" :: held 1.605s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:16:51 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] Created reservations ['24d666ff-1a3c-469b-9c33-e0c66648542a', 'dfddc72a-511e-4249-8e1f-4243cb410bef', '98d031ed-6aa5-4331-b6a3-a7f2575ba2bb', '813c3d97-411e-4d2e-aeeb-e69433f3f5dc'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:16:51 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] Delete snapshot completed successfully. Sep 22 11:16:51 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-385faa43-a9ea-41ff-8b4c-19f656039f99 tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-1b041b05-b673-413f-babc-4897c6a02111-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:16:52 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-f7f05c67-374b-4efd-81f7-3fed0b71d593 tempest-SnapshotsActionsTest-1885230975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:16:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f7f05c67-374b-4efd-81f7-3fed0b71d593 tempest-SnapshotsActionsTest-1885230975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:16:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f7f05c67-374b-4efd-81f7-3fed0b71d593 tempest-SnapshotsActionsTest-1885230975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:16:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-f7f05c67-374b-4efd-81f7-3fed0b71d593 tempest-SnapshotsActionsTest-1885230975 None] Creating offline snapshot 126f252c-85a0-45de-b0cd-144ad4f8807d of volume ee5af08a-0a79-4819-975a-eb1b96c97aa7 {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:16:52 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2740a869-7a36-48db-9193-5b4ca80388fc]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:16:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f7f05c67-374b-4efd-81f7-3fed0b71d593 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:52 devstack quobyte-client[83313]: System call of process 91997 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f7f05c67-374b-4efd-81f7-3fed0b71d593 tempest-SnapshotsActionsTest-1885230975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81" returned: 0 in 0.535s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-f7f05c67-374b-4efd-81f7-3fed0b71d593 tempest-SnapshotsActionsTest-1885230975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:16:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f7f05c67-374b-4efd-81f7-3fed0b71d593 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.126f252c-85a0-45de-b0cd-144ad4f8807d 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:52 devstack quobyte-client[83313]: System call of process 92004 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:53 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=59, name=volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.126f252c-85a0-45de-b0cd-144ad4f8807d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:16:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f7f05c67-374b-4efd-81f7-3fed0b71d593 tempest-SnapshotsActionsTest-1885230975 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.126f252c-85a0-45de-b0cd-144ad4f8807d 1G" returned: 0 in 0.764s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f7f05c67-374b-4efd-81f7-3fed0b71d593 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.126f252c-85a0-45de-b0cd-144ad4f8807d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:53 devstack quobyte-client[83313]: System call of process 92026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f7f05c67-374b-4efd-81f7-3fed0b71d593 tempest-SnapshotsActionsTest-1885230975 None] CMD "qemu-img rebase -u -b volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.126f252c-85a0-45de-b0cd-144ad4f8807d" returned: 0 in 0.437s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-f7f05c67-374b-4efd-81f7-3fed0b71d593 tempest-SnapshotsActionsTest-1885230975 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.126f252c-85a0-45de-b0cd-144ad4f8807d is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:16:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f7f05c67-374b-4efd-81f7-3fed0b71d593 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.126f252c-85a0-45de-b0cd-144ad4f8807d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f7f05c67-374b-4efd-81f7-3fed0b71d593 tempest-SnapshotsActionsTest-1885230975 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.126f252c-85a0-45de-b0cd-144ad4f8807d" returned: 0 in 0.500s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-f7f05c67-374b-4efd-81f7-3fed0b71d593 tempest-SnapshotsActionsTest-1885230975 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:16:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f7f05c67-374b-4efd-81f7-3fed0b71d593 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.126f252c-85a0-45de-b0cd-144ad4f8807d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f7f05c67-374b-4efd-81f7-3fed0b71d593 tempest-SnapshotsActionsTest-1885230975 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.126f252c-85a0-45de-b0cd-144ad4f8807d" returned: 0 in 0.249s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f7f05c67-374b-4efd-81f7-3fed0b71d593 tempest-SnapshotsActionsTest-1885230975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.224s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:16:55 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-f7f05c67-374b-4efd-81f7-3fed0b71d593 tempest-SnapshotsActionsTest-1885230975 None] Create snapshot completed successfully Sep 22 11:16:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] Acquiring lock "cinder-126f252c-85a0-45de-b0cd-144ad4f8807d-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:16:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-126f252c-85a0-45de-b0cd-144ad4f8807d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:16:56 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:16:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] Acquiring lock "cinder-quobyte-ee5af08a-0a79-4819-975a-eb1b96c97aa7" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:16:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-quobyte-ee5af08a-0a79-4819-975a-eb1b96c97aa7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:16:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] Acquiring lock "cinder-quobyte-126f252c-85a0-45de-b0cd-144ad4f8807d" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:16:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-quobyte-126f252c-85a0-45de-b0cd-144ad4f8807d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:16:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] Deleting offline snapshot 126f252c-85a0-45de-b0cd-144ad4f8807d of volume ee5af08a-0a79-4819-975a-eb1b96c97aa7 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:16:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] snapshot_file for this snap is: volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.126f252c-85a0-45de-b0cd-144ad4f8807d {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:16:56 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb742749-8cc1-436f-89d1-efc83d3c2b89]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:16:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.126f252c-85a0-45de-b0cd-144ad4f8807d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:57 devstack quobyte-client[83313]: System call of process 92056 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.126f252c-85a0-45de-b0cd-144ad4f8807d" returned: 0 in 0.428s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:16:57 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e990c3-55c2-4cd4-9cfb-b6fbb7ba3e8d]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:16:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:57 devstack quobyte-client[83313]: System call of process 92059 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81" returned: 0 in 0.425s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:16:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.126f252c-85a0-45de-b0cd-144ad4f8807d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:57 devstack quobyte-client[83313]: System call of process 92062 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:57 devstack quobyte-client[83313]: System call of process 92062 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:16:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.126f252c-85a0-45de-b0cd-144ad4f8807d" returned: 0 in 0.269s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.126f252c-85a0-45de-b0cd-144ad4f8807d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:16:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.126f252c-85a0-45de-b0cd-144ad4f8807d" returned: 0 in 0.097s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:16:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-quobyte-126f252c-85a0-45de-b0cd-144ad4f8807d" released by "_delete_snapshot" :: held 1.567s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:16:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-quobyte-ee5af08a-0a79-4819-975a-eb1b96c97aa7" released by "delete_snapshot" :: held 1.595s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:16:58 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] Created reservations ['368c7d98-79bd-4775-a2e9-901724ee77d8', '5f03da9b-c0bc-44ed-bd43-51a7b198d922', 'b9c5205b-cc8a-4d13-8ba3-eab9abb376c0', '92718c54-ab47-4356-a35b-3d8457522569'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:16:58 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] Delete snapshot completed successfully. Sep 22 11:16:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-37d2bd17-6dc5-49d3-af75-23b162dc21e7 tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-126f252c-85a0-45de-b0cd-144ad4f8807d-delete_snapshot" released by "delete_snapshot" :: held 2.113s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:17:00 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-ab869962-e3b3-4dd4-acfe-ad3da12603aa tempest-SnapshotsActionsTest-1885230975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:17:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ab869962-e3b3-4dd4-acfe-ad3da12603aa tempest-SnapshotsActionsTest-1885230975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:17:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ab869962-e3b3-4dd4-acfe-ad3da12603aa tempest-SnapshotsActionsTest-1885230975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:17:00 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-ab869962-e3b3-4dd4-acfe-ad3da12603aa tempest-SnapshotsActionsTest-1885230975 None] Creating offline snapshot 970bf0d0-9d62-4333-ada7-8b94a080b557 of volume ee5af08a-0a79-4819-975a-eb1b96c97aa7 {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:17:00 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[042d76c4-a52f-4666-bc21-d467fc8d3cc2]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:17:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ab869962-e3b3-4dd4-acfe-ad3da12603aa tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:00 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-ef69132e-0029-4a27-a957-bd32ea6ced4a req-c4e5bd2e-2701-46b5-a661-2e449fd4dd47 tempest-TestMinimumBasicScenario-1767541253 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:17:00 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-ef69132e-0029-4a27-a957-bd32ea6ced4a req-c4e5bd2e-2701-46b5-a661-2e449fd4dd47 tempest-TestMinimumBasicScenario-1767541253 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:17:00 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-ef69132e-0029-4a27-a957-bd32ea6ced4a req-c4e5bd2e-2701-46b5-a661-2e449fd4dd47 tempest-TestMinimumBasicScenario-1767541253 None] Terminate volume connection completed successfully. Sep 22 11:17:00 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-ef69132e-0029-4a27-a957-bd32ea6ced4a req-c4e5bd2e-2701-46b5-a661-2e449fd4dd47 tempest-TestMinimumBasicScenario-1767541253 None] Deleting attachment 1ddf85de-f31a-4bc2-9e8c-f865047bb383. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:17:00 devstack quobyte-client[83313]: System call of process 92066 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ab869962-e3b3-4dd4-acfe-ad3da12603aa tempest-SnapshotsActionsTest-1885230975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81" returned: 0 in 0.712s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:00 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-ab869962-e3b3-4dd4-acfe-ad3da12603aa tempest-SnapshotsActionsTest-1885230975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:17:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ab869962-e3b3-4dd4-acfe-ad3da12603aa tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.970bf0d0-9d62-4333-ada7-8b94a080b557 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:01 devstack quobyte-client[83313]: System call of process 92070 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:01 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=60, name=volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.970bf0d0-9d62-4333-ada7-8b94a080b557, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:17:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ab869962-e3b3-4dd4-acfe-ad3da12603aa tempest-SnapshotsActionsTest-1885230975 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.970bf0d0-9d62-4333-ada7-8b94a080b557 1G" returned: 0 in 0.562s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ab869962-e3b3-4dd4-acfe-ad3da12603aa tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.970bf0d0-9d62-4333-ada7-8b94a080b557 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:01 devstack quobyte-client[83313]: System call of process 92076 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:01 devstack quobyte-client[83313]: System call of process 92076 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ab869962-e3b3-4dd4-acfe-ad3da12603aa tempest-SnapshotsActionsTest-1885230975 None] CMD "qemu-img rebase -u -b volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.970bf0d0-9d62-4333-ada7-8b94a080b557" returned: 0 in 0.219s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:01 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-ab869962-e3b3-4dd4-acfe-ad3da12603aa tempest-SnapshotsActionsTest-1885230975 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.970bf0d0-9d62-4333-ada7-8b94a080b557 is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:17:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ab869962-e3b3-4dd4-acfe-ad3da12603aa tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.970bf0d0-9d62-4333-ada7-8b94a080b557 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ab869962-e3b3-4dd4-acfe-ad3da12603aa tempest-SnapshotsActionsTest-1885230975 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.970bf0d0-9d62-4333-ada7-8b94a080b557" returned: 0 in 0.129s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:02 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-ab869962-e3b3-4dd4-acfe-ad3da12603aa tempest-SnapshotsActionsTest-1885230975 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:17:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ab869962-e3b3-4dd4-acfe-ad3da12603aa tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.970bf0d0-9d62-4333-ada7-8b94a080b557 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ab869962-e3b3-4dd4-acfe-ad3da12603aa tempest-SnapshotsActionsTest-1885230975 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.970bf0d0-9d62-4333-ada7-8b94a080b557" returned: 0 in 0.151s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ab869962-e3b3-4dd4-acfe-ad3da12603aa tempest-SnapshotsActionsTest-1885230975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:17:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] Acquiring lock "cinder-76a1c556-2dbf-405e-af30-69cbb3f3272b-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:17:02 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-ab869962-e3b3-4dd4-acfe-ad3da12603aa tempest-SnapshotsActionsTest-1885230975 None] Create snapshot completed successfully Sep 22 11:17:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] Lock "cinder-76a1c556-2dbf-405e-af30-69cbb3f3272b-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:17:03 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:17:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] Acquiring lock "cinder-quobyte-76a1c556-2dbf-405e-af30-69cbb3f3272b" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:17:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] Lock "cinder-quobyte-76a1c556-2dbf-405e-af30-69cbb3f3272b" acquired by "delete_volume" :: waited 0.017s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:17:03 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c630f2c-5e3b-4a2d-b606-f3f8475897de]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:17:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-76a1c556-2dbf-405e-af30-69cbb3f3272b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:04 devstack quobyte-client[83313]: System call of process 92095 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:04 devstack quobyte-client[83313]: System call of process 92095 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] Acquiring lock "cinder-970bf0d0-9d62-4333-ada7-8b94a080b557-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:17:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-76a1c556-2dbf-405e-af30-69cbb3f3272b" returned: 0 in 1.027s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-76a1c556-2dbf-405e-af30-69cbb3f3272b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-970bf0d0-9d62-4333-ada7-8b94a080b557-delete_snapshot" acquired by "delete_snapshot" :: waited 0.423s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:17:04 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:17:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] Acquiring lock "cinder-quobyte-ee5af08a-0a79-4819-975a-eb1b96c97aa7" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:17:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-76a1c556-2dbf-405e-af30-69cbb3f3272b" returned: 0 in 0.471s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-quobyte-ee5af08a-0a79-4819-975a-eb1b96c97aa7" acquired by "delete_snapshot" :: waited 0.173s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:17:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] Acquiring lock "cinder-quobyte-970bf0d0-9d62-4333-ada7-8b94a080b557" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:17:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] Lock "cinder-quobyte-76a1c556-2dbf-405e-af30-69cbb3f3272b" released by "delete_volume" :: held 1.629s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:17:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-quobyte-970bf0d0-9d62-4333-ada7-8b94a080b557" acquired by "_delete_snapshot" :: waited 0.211s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:17:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] Deleting offline snapshot 970bf0d0-9d62-4333-ada7-8b94a080b557 of volume ee5af08a-0a79-4819-975a-eb1b96c97aa7 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:17:05 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] snapshot_file for this snap is: volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.970bf0d0-9d62-4333-ada7-8b94a080b557 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:17:05 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26e2795-e0ab-4621-a8d4-3d7f81e2e745]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:17:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.970bf0d0-9d62-4333-ada7-8b94a080b557 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:05 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] Created reservations ['c321df34-c557-499f-babe-293fa2c42770', '317e11ac-cefb-4815-8db7-be62f7de7d92', '35433597-e6bc-40fe-97af-829432093ceb', '08f7c3e7-90ad-4b25-b098-aac3c37f92e5'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:17:05 devstack quobyte-client[83313]: System call of process 92099 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.970bf0d0-9d62-4333-ada7-8b94a080b557" returned: 0 in 0.903s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:05 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:17:06 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[84752bf1-57e1-453e-971d-f8bbc9934b7e]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:17:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:17:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:17:06 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:17:06 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:17:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:17:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.230s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:06 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:17:06 devstack quobyte-client[83313]: System call of process 92103 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:06 devstack quobyte-client[83313]: System call of process 92103 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:06 devstack quobyte-client[83313]: System call of process 92103 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:06 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] Deleted volume successfully. Sep 22 11:17:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81" returned: 0 in 1.074s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:07 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:17:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.970bf0d0-9d62-4333-ada7-8b94a080b557 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:07 devstack quobyte-client[83313]: System call of process 92107 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:07 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-65633b13-4fa8-4cc7-8046-9d1387a2530e tempest-TestMinimumBasicScenario-1767541253 None] Lock "cinder-76a1c556-2dbf-405e-af30-69cbb3f3272b-delete_volume" released by "delete_volume" :: held 4.737s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:17:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.970bf0d0-9d62-4333-ada7-8b94a080b557" returned: 0 in 0.673s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.970bf0d0-9d62-4333-ada7-8b94a080b557 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.970bf0d0-9d62-4333-ada7-8b94a080b557" returned: 0 in 0.154s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:08 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-quobyte-970bf0d0-9d62-4333-ada7-8b94a080b557" released by "_delete_snapshot" :: held 3.641s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:17:08 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-quobyte-ee5af08a-0a79-4819-975a-eb1b96c97aa7" released by "delete_snapshot" :: held 3.911s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:17:10 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=44,cinder:SELECT=36,cinder:DELETE=4,cinder:INSERT=15 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:17:10 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=35,cinder:UPDATE=26,cinder:DELETE=4,cinder:INSERT=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:17:10 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] Created reservations ['3f1ba728-7d49-483f-858b-887df30c33c7', 'ca69d92a-b419-4b59-a87c-56155bd0f468', '36ee6411-9082-46a5-9dc8-1b93427bc2d1', '73c5ad2f-17fc-46e5-b6e9-7a123cf7ae8f'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:17:10 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] Delete snapshot completed successfully. Sep 22 11:17:10 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e73dcc43-e51e-4db9-8d6b-e8ba111cef8e tempest-SnapshotsActionsTest-1306216044 None] Lock "cinder-970bf0d0-9d62-4333-ada7-8b94a080b557-delete_snapshot" released by "delete_snapshot" :: held 6.215s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:17:12 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] Acquiring lock "cinder-162e95d0-596b-43ef-95b5-7f7e0fb24d81-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:17:12 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] Lock "cinder-162e95d0-596b-43ef-95b5-7f7e0fb24d81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:17:12 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:17:12 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] Acquiring lock "cinder-quobyte-ee5af08a-0a79-4819-975a-eb1b96c97aa7" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:17:12 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] Lock "cinder-quobyte-ee5af08a-0a79-4819-975a-eb1b96c97aa7" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:17:12 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] Acquiring lock "cinder-quobyte-162e95d0-596b-43ef-95b5-7f7e0fb24d81" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:17:12 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] Lock "cinder-quobyte-162e95d0-596b-43ef-95b5-7f7e0fb24d81" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:17:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] Deleting offline snapshot 162e95d0-596b-43ef-95b5-7f7e0fb24d81 of volume ee5af08a-0a79-4819-975a-eb1b96c97aa7 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:17:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] snapshot_file for this snap is: volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:17:12 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[51308ba0-12a3-4b85-92ff-c61f93197816]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:17:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:12 devstack quobyte-client[83313]: System call of process 92151 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:12 devstack quobyte-client[83313]: System call of process 92151 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81" returned: 0 in 0.696s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:13 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:17:13 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b280a0-c2c0-467b-8e96-b17b211a13bf]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:17:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7" returned: 0 in 0.517s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81" returned: 0 in 0.345s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7.162e95d0-596b-43ef-95b5-7f7e0fb24d81" returned: 0 in 0.232s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:14 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] Lock "cinder-quobyte-162e95d0-596b-43ef-95b5-7f7e0fb24d81" released by "_delete_snapshot" :: held 2.274s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:17:14 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] Lock "cinder-quobyte-ee5af08a-0a79-4819-975a-eb1b96c97aa7" released by "delete_snapshot" :: held 2.307s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:17:14 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] Created reservations ['5231ae1e-217f-449f-b6e9-739145723b8d', 'bfb5cda2-2d48-43e9-9238-1600b71d2d24', '5dcfc439-a4f1-4102-9f9e-0222d3e54545', '61e0a508-153a-45de-bba1-575f3de0a61b'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:17:15 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] Delete snapshot completed successfully. Sep 22 11:17:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5beff0b8-1fc1-41ad-bd69-dece862e74d2 tempest-SnapshotsActionsTest-1885230975 None] Lock "cinder-162e95d0-596b-43ef-95b5-7f7e0fb24d81-delete_snapshot" released by "delete_snapshot" :: held 2.855s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:17:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] Acquiring lock "cinder-ee5af08a-0a79-4819-975a-eb1b96c97aa7-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:17:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] Lock "cinder-ee5af08a-0a79-4819-975a-eb1b96c97aa7-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:17:15 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:17:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] Acquiring lock "cinder-quobyte-ee5af08a-0a79-4819-975a-eb1b96c97aa7" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:17:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] Lock "cinder-quobyte-ee5af08a-0a79-4819-975a-eb1b96c97aa7" acquired by "delete_volume" :: waited 0.031s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:17:15 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e65645-a989-4385-899e-c2845bf3d255]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:17:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:16 devstack quobyte-client[83313]: System call of process 92176 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7" returned: 0 in 0.473s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ee5af08a-0a79-4819-975a-eb1b96c97aa7" returned: 0 in 0.132s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:16 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] Lock "cinder-quobyte-ee5af08a-0a79-4819-975a-eb1b96c97aa7" released by "delete_volume" :: held 0.948s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:17:17 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] Created reservations ['7d924507-b70b-4f85-a191-19f385ac19ca', 'c686e449-ad81-4c24-8ac7-a4c91cdefa23', '79df9e4d-b173-40c2-a5fb-d28dc60c54d6', 'f9ff060e-bd46-46a2-abc1-8bdb14c0f5f8'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:17:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:17:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:17:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:17:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:17:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:17:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:17:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:17:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:17:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:17:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:17:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.101s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:17:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.524s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.267s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:17:18 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:17:18 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] Deleted volume successfully. Sep 22 11:17:18 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-7a57a586-1296-4786-8302-33da0167705c tempest-SnapshotsActionsTest-1885230975 None] Lock "cinder-ee5af08a-0a79-4819-975a-eb1b96c97aa7-delete_volume" released by "delete_volume" :: held 3.080s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:17:27 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=16,cinder:INSERT=6,cinder:UPDATE=13 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:17:28 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=25,cinder:SELECT=10,cinder:INSERT=6,cinder:DELETE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:17:43 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Flow 'volume_create_manager' (05b76a22-784f-4f9b-b80a-f8cdd5f16c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4992e94-00fa-43ce-920a-80b426cb32ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4992e94-00fa-43ce-920a-80b426cb32ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-411971936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af1d667-78e3-4d21-bfa8-434075db31c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2aae243cc0a488c90b579236172d8de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:17:43Z,use_quota=True,user_id='7042e0bd7a184d86838a7c44b090a7b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca4076b-c17c-4afb-aae0-0cfadcb3261a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca4076b-c17c-4afb-aae0-0cfadcb3261a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436fe16f-f6e2-4ac2-a482-52ac16228a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436fe16f-f6e2-4ac2-a482-52ac16228a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1af1d667-78e3-4d21-bfa8-434075db31c4', 'volume_name': 'volume-1af1d667-78e3-4d21-bfa8-434075db31c4', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (014215e5-6422-401c-b23d-047f7f56349b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (014215e5-6422-401c-b23d-047f7f56349b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4686d8e-5a1e-4c91-8f4b-14e8c77b646c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:17:43 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Volume 1af1d667-78e3-4d21-bfa8-434075db31c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1af1d667-78e3-4d21-bfa8-434075db31c4', 'volume_size': 1} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-411971936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af1d667-78e3-4d21-bfa8-434075db31c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2aae243cc0a488c90b579236172d8de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:17:43Z,use_quota=True,user_id='7042e0bd7a184d86838a7c44b090a7b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Creating volume 1af1d667-78e3-4d21-bfa8-434075db31c4 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:17:43 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1af1d667-78e3-4d21-bfa8-434075db31c4 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:43 devstack quobyte-client[83313]: System call of process 92281 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:43 devstack quobyte-client[83313]: System call of process 92281 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:43 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=61, name=volume-1af1d667-78e3-4d21-bfa8-434075db31c4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1af1d667-78e3-4d21-bfa8-434075db31c4 1073741824" returned: 0 in 0.403s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1af1d667-78e3-4d21-bfa8-434075db31c4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1af1d667-78e3-4d21-bfa8-434075db31c4" returned: 0 in 0.124s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] <== create_volume: return (602ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.618s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4686d8e-5a1e-4c91-8f4b-14e8c77b646c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1af1d667-78e3-4d21-bfa8-434075db31c4', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81538014-fa4c-46af-a237-43ac817b4818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:17:44 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Volume volume-1af1d667-78e3-4d21-bfa8-434075db31c4 (1af1d667-78e3-4d21-bfa8-434075db31c4): created successfully Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81538014-fa4c-46af-a237-43ac817b4818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Flow 'volume_create_manager' (05b76a22-784f-4f9b-b80a-f8cdd5f16c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:17:44 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Flow 'volume_create_manager' (28666bdb-8ccd-41b8-bf1b-4ef959295c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645ffbe4-7be2-4695-a952-c6aef02bc1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:17:44 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-d7ce8017-e67d-4034-9848-6a05a9907c20 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Created volume successfully. Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645ffbe4-7be2-4695-a952-c6aef02bc1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783a952c-1ae2-4124-b27a-5ff38627548e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0198004890fa484bb175f2daaec8f910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:17:44Z,use_quota=True,user_id='4b816914209d4b28a9262fb5d8e13464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7450dd3b-4e07-4e6e-8391-808874043060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7450dd3b-4e07-4e6e-8391-808874043060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa036fe1-7ed5-4f9d-a1c4-e14d1b3dc131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG cinder.image.glance [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Creating Keystone auth plugin from conf {{(pid=83310) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa036fe1-7ed5-4f9d-a1c4-e14d1b3dc131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '783a952c-1ae2-4124-b27a-5ff38627548e', 'volume_name': 'volume-783a952c-1ae2-4124-b27a-5ff38627548e', 'volume_size': 1, 'image_id': '55cc74e0-208a-49eb-829f-7fbc2228ff70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55cc74e0-208a-49eb-829f-7fbc2228ff70', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78f95375e34ae8a8731a4b02b576440d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0198004890fa484bb175f2daaec8f910', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5fafe4aacbbf6e8295543da216b39260de5efca49b0a205fd251eeaca82d19049c4dd45e6956964b0c1ea25b499e8c890252da9cc477205491099b9eb660c31f', 'id': '55cc74e0-208a-49eb-829f-7fbc2228ff70', 'created_at': datetime.datetime(2025, 9, 22, 9, 17, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 9, 17, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55cc74e0-208a-49eb-829f-7fbc2228ff70/file', 'properties': {}}, 'image_service': }' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fdfdb10-ad00-470d-b901-e2863a633f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fdfdb10-ad00-470d-b901-e2863a633f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53b77af-7dbd-403e-bec8-41bcffc5f9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:17:44 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Volume 783a952c-1ae2-4124-b27a-5ff38627548e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-783a952c-1ae2-4124-b27a-5ff38627548e', 'volume_size': 1, 'image_id': '55cc74e0-208a-49eb-829f-7fbc2228ff70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55cc74e0-208a-49eb-829f-7fbc2228ff70', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78f95375e34ae8a8731a4b02b576440d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0198004890fa484bb175f2daaec8f910', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5fafe4aacbbf6e8295543da216b39260de5efca49b0a205fd251eeaca82d19049c4dd45e6956964b0c1ea25b499e8c890252da9cc477205491099b9eb660c31f', 'id': '55cc74e0-208a-49eb-829f-7fbc2228ff70', 'created_at': datetime.datetime(2025, 9, 22, 9, 17, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 9, 17, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55cc74e0-208a-49eb-829f-7fbc2228ff70/file', 'properties': {}}, 'image_service': } Sep 22 11:17:44 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Cloning 783a952c-1ae2-4124-b27a-5ff38627548e from image 55cc74e0-208a-49eb-829f-7fbc2228ff70 at location (None, [{'url': 'file:///opt/stack/data/glance/images/55cc74e0-208a-49eb-829f-7fbc2228ff70', 'metadata': {}}]). {{(pid=83310) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 22 11:17:45 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 22 11:17:45 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Image download 0.00 MB at 0.00 MB/s Sep 22 11:17:45 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2932a295-988f-4429-a27a-0d8d73720617]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:17:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:45 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD Sep 22 11:17:45 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 11:17:46 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Acquiring lock "cinder-1af1d667-78e3-4d21-bfa8-434075db31c4-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:17:46 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Lock "cinder-1af1d667-78e3-4d21-bfa8-434075db31c4-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:17:47 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:17:47 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Acquiring lock "cinder-quobyte-1af1d667-78e3-4d21-bfa8-434075db31c4" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:17:47 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Lock "cinder-quobyte-1af1d667-78e3-4d21-bfa8-434075db31c4" acquired by "delete_volume" :: waited 0.014s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:17:47 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[039dee0c-e1f3-4fdd-9f2d-7ada2df4cc43]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:17:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1af1d667-78e3-4d21-bfa8-434075db31c4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:47 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Sep 22 11:17:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD" returned: 0 in 2.631s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:47 devstack quobyte-client[83313]: System call of process 92291 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1af1d667-78e3-4d21-bfa8-434075db31c4" returned: 0 in 0.716s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1af1d667-78e3-4d21-bfa8-434075db31c4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1af1d667-78e3-4d21-bfa8-434075db31c4" returned: 0 in 0.181s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:48 devstack sudo[92292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD Sep 22 11:17:48 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 11:17:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Lock "cinder-quobyte-1af1d667-78e3-4d21-bfa8-434075db31c4" released by "delete_volume" :: held 1.147s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:17:48 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Created reservations ['1890ca7f-aedb-48b5-be54-ac08b667f990', '3fa18c56-455f-463f-b745-95e41c6ee116', 'a0a8132f-1ef5-4462-a332-4b590e15adcb', 'a3c38760-f7ca-4dc6-9b83-418a9ec7ab8f'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:17:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:17:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:17:48 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:17:48 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:17:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:17:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.205s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:49 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:17:49 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Deleted volume successfully. Sep 22 11:17:49 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3b533736-68ba-4088-9658-ec3369827845 tempest-VolumeQuotasNegativeTestJSON-322409543 None] Lock "cinder-1af1d667-78e3-4d21-bfa8-434075db31c4-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:17:50 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root Sep 22 11:17:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD" returned: 1 in 3.031s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:17:50 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Temporary image 55cc74e0-208a-49eb-829f-7fbc2228ff70 is fetched for user 4b816914209d4b28a9262fb5d8e13464. {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 22 11:17:51 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[da72a010-dccc-4dc9-89f1-8766e78f93e4]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:17:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:51 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD Sep 22 11:17:51 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 11:17:53 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Sep 22 11:17:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD" returned: 0 in 2.615s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:54 devstack sudo[92313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD Sep 22 11:17:54 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 11:17:56 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root Sep 22 11:17:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD" returned: 1 in 2.564s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:17:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:17:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:17:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783a952c-1ae2-4124-b27a-5ff38627548e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0198004890fa484bb175f2daaec8f910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:17:44Z,use_quota=True,user_id='4b816914209d4b28a9262fb5d8e13464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:17:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Creating volume 783a952c-1ae2-4124-b27a-5ff38627548e {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:17:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:17:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:17:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:17:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:17:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:17:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:17:56 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:17:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:56 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=62, name=volume-783a952c-1ae2-4124-b27a-5ff38627548e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:17:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e 1073741824" returned: 0 in 0.463s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e" returned: 0 in 0.161s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] <== create_volume: return (792ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Attempting download of 55cc74e0-208a-49eb-829f-7fbc2228ff70 ((None, [{'url': 'file:///opt/stack/data/glance/images/55cc74e0-208a-49eb-829f-7fbc2228ff70', 'metadata': {}}])) to volume 783a952c-1ae2-4124-b27a-5ff38627548e. {{(pid=83310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 22 11:17:57 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Flow 'volume_create_manager' (82bd246c-6423-43c6-a1da-2fcb93607270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b98eae2-b113-40ab-a09e-4c22addcbd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b98eae2-b113-40ab-a09e-4c22addcbd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-972275285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18867149-59f8-4e57-9fed-1a378a526e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974f35c3b0584fcebe7389e9c219ad1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:17:57Z,use_quota=True,user_id='0adead7ccf644b1abf9aa7239e70e6a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcabc6b9-c592-45e8-b59d-4281c4095c78),volume_type_id=fcabc6b9-c592-45e8-b59d-4281c4095c78)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b211fbe-f21f-4ef1-937f-9873a5952af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b211fbe-f21f-4ef1-937f-9873a5952af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e5587b-c532-4499-a252-3c2983c4d9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e5587b-c532-4499-a252-3c2983c4d9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18867149-59f8-4e57-9fed-1a378a526e44', 'volume_name': 'volume-18867149-59f8-4e57-9fed-1a378a526e44', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8619e3bf-8cea-4537-a34e-cce194fd3e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8619e3bf-8cea-4537-a34e-cce194fd3e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a32014-dfce-4d80-9eca-d16d57b7c76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:17:57 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Volume 18867149-59f8-4e57-9fed-1a378a526e44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18867149-59f8-4e57-9fed-1a378a526e44', 'volume_size': 1} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-972275285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18867149-59f8-4e57-9fed-1a378a526e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974f35c3b0584fcebe7389e9c219ad1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:17:57Z,use_quota=True,user_id='0adead7ccf644b1abf9aa7239e70e6a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fcabc6b9-c592-45e8-b59d-4281c4095c78),volume_type_id=fcabc6b9-c592-45e8-b59d-4281c4095c78)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Creating volume 18867149-59f8-4e57-9fed-1a378a526e44 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:17:57 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:17:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-18867149-59f8-4e57-9fed-1a378a526e44 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:57 devstack quobyte-client[83313]: System call of process 92337 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:57 devstack quobyte-client[83313]: System call of process 92337 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:57 devstack quobyte-client[83313]: System call of process 92337 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:57 devstack quobyte-client[83313]: System call of process 92337 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:17:57 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=63, name=volume-18867149-59f8-4e57-9fed-1a378a526e44, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:17:58 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c53ded-b114-40f7-93ea-7f54653208bf]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:17:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55cc74e0-208a-49eb-829f-7fbc2228ff70_0i6u_wct {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-18867149-59f8-4e57-9fed-1a378a526e44 1073741824" returned: 0 in 0.720s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-18867149-59f8-4e57-9fed-1a378a526e44 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-18867149-59f8-4e57-9fed-1a378a526e44" returned: 0 in 0.171s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:58 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] <== create_volume: return (955ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:17:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:17:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a32014-dfce-4d80-9eca-d16d57b7c76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18867149-59f8-4e57-9fed-1a378a526e44', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:17:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a42d36-82ac-4e92-b124-fc62c979bfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:17:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55cc74e0-208a-49eb-829f-7fbc2228ff70_0i6u_wct" returned: 0 in 0.681s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55cc74e0-208a-49eb-829f-7fbc2228ff70_0i6u_wct {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:17:59 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Volume volume-18867149-59f8-4e57-9fed-1a378a526e44 (18867149-59f8-4e57-9fed-1a378a526e44): created successfully Sep 22 11:17:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a42d36-82ac-4e92-b124-fc62c979bfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:17:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Flow 'volume_create_manager' (82bd246c-6423-43c6-a1da-2fcb93607270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:17:59 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-080d8d7c-f40b-43db-9eb7-bd67b440a556 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Created volume successfully. Sep 22 11:17:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55cc74e0-208a-49eb-829f-7fbc2228ff70_0i6u_wct" returned: 1 in 0.653s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:17:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55cc74e0-208a-49eb-829f-7fbc2228ff70_0i6u_wct' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:17:59 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc97e56f-1557-4a41-a666-5660fcc49df7]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:17:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:00 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-52b3a8f6-bfb5-408f-94f6-edc063906ab2 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:18:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD" returned: 0 in 0.719s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-52b3a8f6-bfb5-408f-94f6-edc063906ab2 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:18:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-52b3a8f6-bfb5-408f-94f6-edc063906ab2 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:18:00 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-52b3a8f6-bfb5-408f-94f6-edc063906ab2 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:18:00 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-52b3a8f6-bfb5-408f-94f6-edc063906ab2 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:18:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-52b3a8f6-bfb5-408f-94f6-edc063906ab2 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:18:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-52b3a8f6-bfb5-408f-94f6-edc063906ab2 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD" returned: 1 in 0.708s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:18:01 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] 55cc74e0-208a-49eb-829f-7fbc2228ff70 was raw, converting to raw {{(pid=83310) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 22 11:18:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-52b3a8f6-bfb5-408f-94f6-edc063906ab2 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.387s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:01 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-52b3a8f6-bfb5-408f-94f6-edc063906ab2 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:18:01 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=62, name=volume-783a952c-1ae2-4124-b27a-5ff38627548e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:18:01 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-52b3a8f6-bfb5-408f-94f6-edc063906ab2 tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Retype volume completed successfully. Sep 22 11:18:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e" returned: 0 in 0.408s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:01 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_55cc74e0-208a-49eb-829f-7fbc2228ff70_jo4d14tjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e {{(pid=83310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 22 11:18:01 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Converted 0.00 MB image at 0.00 MB/s Sep 22 11:18:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:01 devstack quobyte-client[83313]: System call of process 92354 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:01 devstack quobyte-client[83313]: System call of process 92354 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:01 devstack quobyte-client[83313]: System call of process 92354 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:01 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Acquiring lock "cinder-18867149-59f8-4e57-9fed-1a378a526e44-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:18:01 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Lock "cinder-18867149-59f8-4e57-9fed-1a378a526e44-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:18:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e 1G" returned: 0 in 0.469s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:02 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88bcf42-a80e-47f0-9afb-52a8e24d6ace]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:18:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:02 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:18:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Acquiring lock "cinder-quobyte-18867149-59f8-4e57-9fed-1a378a526e44" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:18:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Lock "cinder-quobyte-18867149-59f8-4e57-9fed-1a378a526e44" acquired by "delete_volume" :: waited 0.072s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:18:02 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8402848-9961-4a62-8f65-a95c28f59fd3]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:18:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-18867149-59f8-4e57-9fed-1a378a526e44 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:02 devstack quobyte-client[83313]: System call of process 92357 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:02 devstack quobyte-client[83313]: System call of process 92357 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e" returned: 0 in 0.729s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:03 devstack quobyte-client[83313]: System call of process 92358 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:03 devstack quobyte-client[83313]: System call of process 92358 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-18867149-59f8-4e57-9fed-1a378a526e44" returned: 0 in 0.578s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-18867149-59f8-4e57-9fed-1a378a526e44 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:03 devstack quobyte-client[83313]: System call of process 92360 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-18867149-59f8-4e57-9fed-1a378a526e44" returned: 0 in 0.164s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e" returned: 1 in 0.623s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:18:03 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Downloaded image 55cc74e0-208a-49eb-829f-7fbc2228ff70 ((None, [{'url': 'file:///opt/stack/data/glance/images/55cc74e0-208a-49eb-829f-7fbc2228ff70', 'metadata': {}}])) to volume 783a952c-1ae2-4124-b27a-5ff38627548e successfully. {{(pid=83310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 22 11:18:03 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Temporary image 55cc74e0-208a-49eb-829f-7fbc2228ff70 for user 4b816914209d4b28a9262fb5d8e13464 is deleted. {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 22 11:18:03 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Marking volume 783a952c-1ae2-4124-b27a-5ff38627548e as bootable. {{(pid=83310) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 22 11:18:03 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Copying metadata from image 55cc74e0-208a-49eb-829f-7fbc2228ff70 to 783a952c-1ae2-4124-b27a-5ff38627548e. {{(pid=83310) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 11:18:03 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Creating volume glance metadata for volume 783a952c-1ae2-4124-b27a-5ff38627548e backed by image 55cc74e0-208a-49eb-829f-7fbc2228ff70 with: {'image_id': '55cc74e0-208a-49eb-829f-7fbc2228ff70', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '78f95375e34ae8a8731a4b02b576440d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83310) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 11:18:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Lock "cinder-quobyte-18867149-59f8-4e57-9fed-1a378a526e44" released by "delete_volume" :: held 1.087s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:18:03 devstack cinder-volume[83310]: WARNING cinder.quota [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:18:03 devstack cinder-volume[83310]: WARNING cinder.quota [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:18:03 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Created reservations ['5dc3e9ff-d334-4de5-a93a-4254d8de3e17', 'bb8a7871-8e5b-4650-9ee8-010cd4fc77f4', '63e1d31e-e900-4cbf-8938-0ba096290ced', 'a2c42e6e-b046-4946-8831-b32b429d0b9f'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:18:04 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53b77af-7dbd-403e-bec8-41bcffc5f9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-783a952c-1ae2-4124-b27a-5ff38627548e', 'volume_size': 1, 'image_id': '55cc74e0-208a-49eb-829f-7fbc2228ff70', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55cc74e0-208a-49eb-829f-7fbc2228ff70', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78f95375e34ae8a8731a4b02b576440d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0198004890fa484bb175f2daaec8f910', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5fafe4aacbbf6e8295543da216b39260de5efca49b0a205fd251eeaca82d19049c4dd45e6956964b0c1ea25b499e8c890252da9cc477205491099b9eb660c31f', 'id': '55cc74e0-208a-49eb-829f-7fbc2228ff70', 'created_at': datetime.datetime(2025, 9, 22, 9, 17, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 9, 17, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55cc74e0-208a-49eb-829f-7fbc2228ff70/file', 'properties': {}}, 'image_service': }' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:18:04 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bae8176-37a3-40f0-9dfc-cf325b295175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:18:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:18:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:18:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:18:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:18:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:18:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.150s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:04 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:18:04 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Deleted volume successfully. Sep 22 11:18:04 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Volume volume-783a952c-1ae2-4124-b27a-5ff38627548e (783a952c-1ae2-4124-b27a-5ff38627548e): created successfully Sep 22 11:18:04 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bae8176-37a3-40f0-9dfc-cf325b295175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:18:04 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Flow 'volume_create_manager' (28666bdb-8ccd-41b8-bf1b-4ef959295c2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:18:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-03ca3bba-d7ce-41a2-bde6-dd8ecbeeef9a tempest-VolumeRetypeWithoutMigrationTest-514373398 None] Lock "cinder-18867149-59f8-4e57-9fed-1a378a526e44-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:18:04 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-17ae817b-9ab8-431a-ae9f-1634a63b99b9 tempest-VolumeImageDependencyTests-1147568928 None] Created volume successfully. Sep 22 11:18:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] Acquiring lock "cinder-783a952c-1ae2-4124-b27a-5ff38627548e-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:18:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] Lock "cinder-783a952c-1ae2-4124-b27a-5ff38627548e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:18:05 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:18:05 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] Acquiring lock "cinder-quobyte-783a952c-1ae2-4124-b27a-5ff38627548e" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:18:05 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] Lock "cinder-quobyte-783a952c-1ae2-4124-b27a-5ff38627548e" acquired by "delete_volume" :: waited 0.027s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:18:05 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[43db52e9-5bbc-4bc8-b59b-ec0500f9796e]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:18:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:05 devstack quobyte-client[83313]: System call of process 92368 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:05 devstack quobyte-client[83313]: System call of process 92368 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:05 devstack quobyte-client[83313]: System call of process 92368 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:05 devstack quobyte-client[83313]: System call of process 92368 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:05 devstack quobyte-client[83313]: System call of process 92368 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e" returned: 0 in 0.509s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:06 devstack quobyte-client[83313]: System call of process 92370 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:06 devstack quobyte-client[83313]: System call of process 92370 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e" returned: 1 in 0.543s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:18:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-783a952c-1ae2-4124-b27a-5ff38627548e" returned: 0 in 0.134s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:06 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] Lock "cinder-quobyte-783a952c-1ae2-4124-b27a-5ff38627548e" released by "delete_volume" :: held 1.571s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:18:07 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] Created reservations ['d577fbdb-231d-458b-9ace-7a7e8e7fc29e', 'a35cabc7-55cb-4fb2-9ebc-b9cb9ea8c082', 'd89bc673-934a-4706-b12f-03ecba9c783d', '0d4d20ee-5845-43ad-afdf-c2225df4ce1a'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:18:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:18:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:18:07 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:18:07 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:18:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:18:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.107s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:07 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:18:07 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] Deleted volume successfully. Sep 22 11:18:08 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c5e3a032-4048-456a-89fb-9bed992e6976 tempest-VolumeImageDependencyTests-1147568928 None] Lock "cinder-783a952c-1ae2-4124-b27a-5ff38627548e-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:18:15 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:18:15 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Flow 'volume_create_manager' (5d4c76f2-b3fb-416e-a7bd-08a6b7c2f460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c7f0e8-0b19-4d1c-8473-60f05e464b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c7f0e8-0b19-4d1c-8473-60f05e464b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a35b92-9177-4ac2-89f5-f2d1bb131109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044bc162050b47bab87a39796023e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:18:16Z,use_quota=True,user_id='e67c2f5c188d427dad15b8643f43e962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad241fa-d5e5-4a08-aa6a-1a9dd2dfa848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad241fa-d5e5-4a08-aa6a-1a9dd2dfa848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273ed949-0fd0-4692-a699-25ef293a365d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273ed949-0fd0-4692-a699-25ef293a365d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42a35b92-9177-4ac2-89f5-f2d1bb131109', 'volume_name': 'volume-42a35b92-9177-4ac2-89f5-f2d1bb131109', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82613002-cf56-4c1f-bb44-8cbbb21adef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82613002-cf56-4c1f-bb44-8cbbb21adef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01455822-f45f-4eb2-be38-d9a4508fb855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:18:16 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Volume 42a35b92-9177-4ac2-89f5-f2d1bb131109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42a35b92-9177-4ac2-89f5-f2d1bb131109', 'volume_size': 1} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a35b92-9177-4ac2-89f5-f2d1bb131109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044bc162050b47bab87a39796023e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:18:16Z,use_quota=True,user_id='e67c2f5c188d427dad15b8643f43e962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Creating volume 42a35b92-9177-4ac2-89f5-f2d1bb131109 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:18:16 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-42a35b92-9177-4ac2-89f5-f2d1bb131109 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:16 devstack quobyte-client[83313]: System call of process 92415 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:16 devstack quobyte-client[83313]: System call of process 92415 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:16 devstack quobyte-client[83313]: System call of process 92415 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:16 devstack quobyte-client[83313]: System call of process 92415 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:16 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=64, name=volume-42a35b92-9177-4ac2-89f5-f2d1bb131109, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-42a35b92-9177-4ac2-89f5-f2d1bb131109 1073741824" returned: 0 in 0.659s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-42a35b92-9177-4ac2-89f5-f2d1bb131109 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-42a35b92-9177-4ac2-89f5-f2d1bb131109" returned: 0 in 0.335s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] <== create_volume: return (1095ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:18:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:18:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:18:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:18:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:18:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:18:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:18:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:18:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01455822-f45f-4eb2-be38-d9a4508fb855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a35b92-9177-4ac2-89f5-f2d1bb131109', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:18:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40532ea-f425-4b6d-b819-a2a0c6fb3538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:18:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.522s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:18 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:18:18 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Volume volume-42a35b92-9177-4ac2-89f5-f2d1bb131109 (42a35b92-9177-4ac2-89f5-f2d1bb131109): created successfully Sep 22 11:18:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40532ea-f425-4b6d-b819-a2a0c6fb3538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:18:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Flow 'volume_create_manager' (5d4c76f2-b3fb-416e-a7bd-08a6b7c2f460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:18:18 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-4e76739d-fd84-413e-9054-0cbce99cfd4f tempest-CinderUnicodeTest-1513514556 None] Created volume successfully. Sep 22 11:18:19 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:18:19 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:18:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Flow 'volume_create_manager' (95f41e8d-2db4-423d-af66-a6d2157d7183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:18:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bd5c13-4057-4295-8e04-6fc4826966bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:18:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bd5c13-4057-4295-8e04-6fc4826966bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:18:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-330190250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff688d0c-53e4-44b3-8909-21f71b55aada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044bc162050b47bab87a39796023e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:18:20Z,use_quota=True,user_id='e67c2f5c188d427dad15b8643f43e962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:18:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc1f89c-54d2-4655-8906-dd56b7cdd58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:18:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc1f89c-54d2-4655-8906-dd56b7cdd58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:18:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185143c5-acfd-4b1a-a920-465ba6c6027c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:18:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185143c5-acfd-4b1a-a920-465ba6c6027c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff688d0c-53e4-44b3-8909-21f71b55aada', 'volume_name': 'volume-ff688d0c-53e4-44b3-8909-21f71b55aada', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:18:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a511b4e-3cb4-4324-8cb9-b6157c1c00a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:18:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a511b4e-3cb4-4324-8cb9-b6157c1c00a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:18:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58dba90-5415-4b6e-bb9b-bd06cc871751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:18:19 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Volume ff688d0c-53e4-44b3-8909-21f71b55aada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff688d0c-53e4-44b3-8909-21f71b55aada', 'volume_size': 1} Sep 22 11:18:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:18:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:18:20 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:18:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-330190250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff688d0c-53e4-44b3-8909-21f71b55aada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='044bc162050b47bab87a39796023e842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:18:20Z,use_quota=True,user_id='e67c2f5c188d427dad15b8643f43e962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:18:20 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Creating volume ff688d0c-53e4-44b3-8909-21f71b55aada {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:18:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:18:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:18:20 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:18:20 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:18:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:18:20 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:18:20 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:18:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:20 devstack quobyte-client[83313]: System call of process 92421 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:20 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=65, name=volume-ff688d0c-53e4-44b3-8909-21f71b55aada, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:18:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada 1073741824" returned: 0 in 0.456s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada" returned: 0 in 0.182s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:20 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] <== create_volume: return (751ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:18:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:18:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58dba90-5415-4b6e-bb9b-bd06cc871751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff688d0c-53e4-44b3-8909-21f71b55aada', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:18:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13e6500-8fcb-4b95-b218-82190da02e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:18:21 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Volume volume-ff688d0c-53e4-44b3-8909-21f71b55aada (ff688d0c-53e4-44b3-8909-21f71b55aada): created successfully Sep 22 11:18:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13e6500-8fcb-4b95-b218-82190da02e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:18:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Flow 'volume_create_manager' (95f41e8d-2db4-423d-af66-a6d2157d7183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:18:21 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-7c6b5117-1a86-43e8-abe6-c3d5bee82f3a tempest-CinderUnicodeTest-1513514556 None] Created volume successfully. Sep 22 11:18:22 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:18:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:18:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:18:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] Creating offline snapshot f074227b-bcc1-4563-bb0f-7eb36741b9f7 of volume ff688d0c-53e4-44b3-8909-21f71b55aada {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:18:22 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f07c944-cd59-40fe-b1fc-6aabaf966b26]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:18:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:22 devstack quobyte-client[83313]: System call of process 92425 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada" returned: 0 in 0.655s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.f074227b-bcc1-4563-bb0f-7eb36741b9f7 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:23 devstack quobyte-client[83313]: System call of process 92428 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:23 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=66, name=volume-ff688d0c-53e4-44b3-8909-21f71b55aada.f074227b-bcc1-4563-bb0f-7eb36741b9f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:18:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.f074227b-bcc1-4563-bb0f-7eb36741b9f7 1G" returned: 0 in 0.406s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ff688d0c-53e4-44b3-8909-21f71b55aada -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.f074227b-bcc1-4563-bb0f-7eb36741b9f7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] CMD "qemu-img rebase -u -b volume-ff688d0c-53e4-44b3-8909-21f71b55aada -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.f074227b-bcc1-4563-bb0f-7eb36741b9f7" returned: 0 in 0.244s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.f074227b-bcc1-4563-bb0f-7eb36741b9f7 is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:18:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.f074227b-bcc1-4563-bb0f-7eb36741b9f7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.f074227b-bcc1-4563-bb0f-7eb36741b9f7" returned: 0 in 0.137s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:18:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.f074227b-bcc1-4563-bb0f-7eb36741b9f7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.f074227b-bcc1-4563-bb0f-7eb36741b9f7" returned: 0 in 0.143s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.info" returned: 0 in 0.150s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:18:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.info" returned: 0 in 0.126s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.336s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:18:24 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-c06201a8-7e70-4968-bc83-34d6269b5a10 tempest-CinderUnicodeTest-1513514556 None] Create snapshot completed successfully Sep 22 11:18:25 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] Acquiring lock "cinder-f074227b-bcc1-4563-bb0f-7eb36741b9f7-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:18:25 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] Lock "cinder-f074227b-bcc1-4563-bb0f-7eb36741b9f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.104s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:18:25 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:18:25 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] Acquiring lock "cinder-quobyte-ff688d0c-53e4-44b3-8909-21f71b55aada" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:18:25 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] Lock "cinder-quobyte-ff688d0c-53e4-44b3-8909-21f71b55aada" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:18:25 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] Acquiring lock "cinder-quobyte-f074227b-bcc1-4563-bb0f-7eb36741b9f7" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:18:25 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] Lock "cinder-quobyte-f074227b-bcc1-4563-bb0f-7eb36741b9f7" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:18:25 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] Deleting offline snapshot f074227b-bcc1-4563-bb0f-7eb36741b9f7 of volume ff688d0c-53e4-44b3-8909-21f71b55aada {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:18:25 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] snapshot_file for this snap is: volume-ff688d0c-53e4-44b3-8909-21f71b55aada.f074227b-bcc1-4563-bb0f-7eb36741b9f7 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:18:25 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a204f6-4341-43fe-9d40-bc0b072ae0d1]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:18:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.f074227b-bcc1-4563-bb0f-7eb36741b9f7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:26 devstack quobyte-client[83313]: System call of process 92441 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:26 devstack quobyte-client[83313]: System call of process 92441 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:26 devstack quobyte-client[83313]: System call of process 92441 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.f074227b-bcc1-4563-bb0f-7eb36741b9f7" returned: 0 in 0.599s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff688d0c-53e4-44b3-8909-21f71b55aada(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:18:26 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dbeec0-9c2e-478d-8016-538cdcf9cd7d]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:18:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:27 devstack quobyte-client[83313]: System call of process 92448 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:27 devstack quobyte-client[83313]: System call of process 92448 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada" returned: 0 in 0.520s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.f074227b-bcc1-4563-bb0f-7eb36741b9f7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.f074227b-bcc1-4563-bb0f-7eb36741b9f7" returned: 0 in 0.266s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.f074227b-bcc1-4563-bb0f-7eb36741b9f7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada.f074227b-bcc1-4563-bb0f-7eb36741b9f7" returned: 0 in 0.109s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:27 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] Lock "cinder-quobyte-f074227b-bcc1-4563-bb0f-7eb36741b9f7" released by "_delete_snapshot" :: held 1.981s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:18:27 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] Lock "cinder-quobyte-ff688d0c-53e4-44b3-8909-21f71b55aada" released by "delete_snapshot" :: held 2.013s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:18:28 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] Created reservations ['4af2e6cd-9c35-4045-a35e-96921257401a', '2fd4ef41-74e6-4c11-87bf-fa822b5b4501', '9f29dfdf-858e-4919-90c0-eebd3de4383d', 'd6daae9c-6050-4a9b-a82c-ec0692d6f99d'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:18:28 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] Delete snapshot completed successfully. Sep 22 11:18:28 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ad44bd9b-2ae6-4e3f-b436-e17a8cc16964 tempest-CinderUnicodeTest-1513514556 None] Lock "cinder-f074227b-bcc1-4563-bb0f-7eb36741b9f7-delete_snapshot" released by "delete_snapshot" :: held 2.516s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:18:29 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] Acquiring lock "cinder-ff688d0c-53e4-44b3-8909-21f71b55aada-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:18:29 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] Lock "cinder-ff688d0c-53e4-44b3-8909-21f71b55aada-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:18:29 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:18:29 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] Acquiring lock "cinder-quobyte-ff688d0c-53e4-44b3-8909-21f71b55aada" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:18:29 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] Lock "cinder-quobyte-ff688d0c-53e4-44b3-8909-21f71b55aada" acquired by "delete_volume" :: waited 0.012s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:18:29 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf4e1c5-d25b-47fb-ae9b-705edb1588cf]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:18:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada" returned: 0 in 0.582s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ff688d0c-53e4-44b3-8909-21f71b55aada" returned: 0 in 0.122s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:30 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] Lock "cinder-quobyte-ff688d0c-53e4-44b3-8909-21f71b55aada" released by "delete_volume" :: held 0.923s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:18:30 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] Created reservations ['decea44e-365c-43cf-beb3-c34c168e26e0', '692ab495-a0b5-4f76-8cd4-04111dbec5a0', '3ae0c41c-6af6-4b7b-8cd5-810f1ae223bd', '0f1ddf8a-5aca-49f6-b38d-49ffc9eae8db'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:18:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:18:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:18:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:18:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:18:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:18:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.223s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:31 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:18:31 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] Deleted volume successfully. Sep 22 11:18:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-98df7a63-5925-4410-9113-7f9092004944 tempest-CinderUnicodeTest-1513514556 None] Lock "cinder-ff688d0c-53e4-44b3-8909-21f71b55aada-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:18:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] Acquiring lock "cinder-42a35b92-9177-4ac2-89f5-f2d1bb131109-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:18:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] Lock "cinder-42a35b92-9177-4ac2-89f5-f2d1bb131109-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:18:32 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:18:32 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] Acquiring lock "cinder-quobyte-42a35b92-9177-4ac2-89f5-f2d1bb131109" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:18:32 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] Lock "cinder-quobyte-42a35b92-9177-4ac2-89f5-f2d1bb131109" acquired by "delete_volume" :: waited 0.020s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:18:32 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e110b38-35b6-49e9-a7f5-924fe255d1ee]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:18:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-42a35b92-9177-4ac2-89f5-f2d1bb131109 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:32 devstack quobyte-client[83313]: System call of process 92498 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:18:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-42a35b92-9177-4ac2-89f5-f2d1bb131109" returned: 0 in 0.805s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-42a35b92-9177-4ac2-89f5-f2d1bb131109 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-42a35b92-9177-4ac2-89f5-f2d1bb131109" returned: 0 in 0.208s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:33 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] Lock "cinder-quobyte-42a35b92-9177-4ac2-89f5-f2d1bb131109" released by "delete_volume" :: held 1.293s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:18:33 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] Created reservations ['1130a4b9-114f-45ee-a996-fe9507f0dc4d', '30656965-1361-422b-80a6-9e3b275519ce', 'fbcf0316-c04f-4e65-a6fa-9b1c20a5e159', 'e30ae9fc-2da2-428b-b625-7540b44b3d69'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:18:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:18:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:18:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:18:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:18:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:18:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:18:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.245s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:18:34 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:18:34 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] Deleted volume successfully. Sep 22 11:18:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ff56ee1d-596a-44b7-b67c-5a980b57392c tempest-CinderUnicodeTest-1513514556 None] Lock "cinder-42a35b92-9177-4ac2-89f5-f2d1bb131109-delete_volume" released by "delete_volume" :: held 3.007s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:18:44 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=57,cinder:SELECT=51,cinder:DELETE=6,cinder:INSERT=18 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:18:44 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=47,cinder:UPDATE=69,cinder:DELETE=5,cinder:INSERT=15 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:18:47 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-abd53c45-a3cd-4b8c-9219-5f70f909a663 req-48adf566-3bd1-42a3-808e-5220a26b8915 tempest-AttachVolumeNegativeTest-524744203 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:18:47 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-abd53c45-a3cd-4b8c-9219-5f70f909a663 req-48adf566-3bd1-42a3-808e-5220a26b8915 tempest-AttachVolumeNegativeTest-524744203 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:18:47 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-abd53c45-a3cd-4b8c-9219-5f70f909a663 req-48adf566-3bd1-42a3-808e-5220a26b8915 tempest-AttachVolumeNegativeTest-524744203 None] Terminate volume connection completed successfully. Sep 22 11:18:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-abd53c45-a3cd-4b8c-9219-5f70f909a663 req-48adf566-3bd1-42a3-808e-5220a26b8915 tempest-AttachVolumeNegativeTest-524744203 None] Deleting attachment c2e8bec3-6b94-49e8-b0f6-f3bddcef0cab. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:18:57 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:18:57 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:19:17 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Flow 'volume_create_manager' (315f2e6d-ecea-4ebd-86dc-c72629624647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f64a4b-bd30-47da-a338-28f7d44bc5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f64a4b-bd30-47da-a338-28f7d44bc5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1589059647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4087acb-4cd7-46eb-9989-92a936d4d144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d687ce1517445348be977591e4f34c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:19:17Z,use_quota=True,user_id='cdb32c39a2094872ac893da572a985de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6239d8-4f2e-4c8d-9363-7bfb1a265041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6239d8-4f2e-4c8d-9363-7bfb1a265041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875de3b2-531d-447c-b380-3430505e4ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875de3b2-531d-447c-b380-3430505e4ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4087acb-4cd7-46eb-9989-92a936d4d144', 'volume_name': 'volume-b4087acb-4cd7-46eb-9989-92a936d4d144', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ce73fa-d41c-4827-9997-884086ca22e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ce73fa-d41c-4827-9997-884086ca22e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87335368-79a5-4d5d-878f-d35b1464f536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:17 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Volume b4087acb-4cd7-46eb-9989-92a936d4d144: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4087acb-4cd7-46eb-9989-92a936d4d144', 'volume_size': 1} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1589059647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4087acb-4cd7-46eb-9989-92a936d4d144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d687ce1517445348be977591e4f34c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:19:17Z,use_quota=True,user_id='cdb32c39a2094872ac893da572a985de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Creating volume b4087acb-4cd7-46eb-9989-92a936d4d144 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:19:17 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b4087acb-4cd7-46eb-9989-92a936d4d144 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:17 devstack quobyte-client[83313]: System call of process 92672 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:19:17 devstack quobyte-client[83313]: System call of process 92672 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:19:17 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=68, name=volume-b4087acb-4cd7-46eb-9989-92a936d4d144, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.240s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:19:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b4087acb-4cd7-46eb-9989-92a936d4d144 1073741824" returned: 0 in 0.711s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b4087acb-4cd7-46eb-9989-92a936d4d144 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b4087acb-4cd7-46eb-9989-92a936d4d144" returned: 0 in 0.177s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] <== create_volume: return (955ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:19:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:19:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87335368-79a5-4d5d-878f-d35b1464f536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4087acb-4cd7-46eb-9989-92a936d4d144', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717d9ddd-ccfd-4eb7-9e57-6b2eabc35a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:18 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Volume volume-b4087acb-4cd7-46eb-9989-92a936d4d144 (b4087acb-4cd7-46eb-9989-92a936d4d144): created successfully Sep 22 11:19:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717d9ddd-ccfd-4eb7-9e57-6b2eabc35a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Flow 'volume_create_manager' (315f2e6d-ecea-4ebd-86dc-c72629624647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:19:18 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-5cd2608d-435c-4ab0-9415-aafc3ad7fdcc tempest-VolumesActionsTest-86593521 None] Created volume successfully. Sep 22 11:19:19 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-98a574df-a77e-495d-abb0-5dfb06afcc4a tempest-VolumesActionsTest-86593521 None] Acquiring lock "cinder-b4087acb-4cd7-46eb-9989-92a936d4d144" by "attach_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:19:19 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-98a574df-a77e-495d-abb0-5dfb06afcc4a tempest-VolumesActionsTest-86593521 None] Lock "cinder-b4087acb-4cd7-46eb-9989-92a936d4d144" acquired by "attach_volume" :: waited 0.050s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:19:19 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-98a574df-a77e-495d-abb0-5dfb06afcc4a tempest-VolumesActionsTest-86593521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:19:19 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-98a574df-a77e-495d-abb0-5dfb06afcc4a tempest-VolumesActionsTest-86593521 None] Attaching volume b4087acb-4cd7-46eb-9989-92a936d4d144 to instance 177bb9d9-2df2-4038-9739-c739798f67eb at mountpoint /dev/vdb on host None. Sep 22 11:19:19 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-98a574df-a77e-495d-abb0-5dfb06afcc4a tempest-VolumesActionsTest-86593521 None] Attach volume completed successfully. Sep 22 11:19:19 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-98a574df-a77e-495d-abb0-5dfb06afcc4a tempest-VolumesActionsTest-86593521 None] Lock "cinder-b4087acb-4cd7-46eb-9989-92a936d4d144" released by "attach_volume" :: held 0.276s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:19:20 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-5a4eb09b-afb5-4167-901d-3fd8d670fa19 tempest-VolumesActionsTest-1279443046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:19:20 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-5a4eb09b-afb5-4167-901d-3fd8d670fa19 tempest-VolumesActionsTest-1279443046 None] Terminate volume connection completed successfully. Sep 22 11:19:20 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5a4eb09b-afb5-4167-901d-3fd8d670fa19 tempest-VolumesActionsTest-1279443046 None] Acquiring lock "cinder-b4087acb-4cd7-46eb-9989-92a936d4d144-detach_volume" by "detach_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:19:21 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5a4eb09b-afb5-4167-901d-3fd8d670fa19 tempest-VolumesActionsTest-1279443046 None] Lock "cinder-b4087acb-4cd7-46eb-9989-92a936d4d144-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:19:21 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-5a4eb09b-afb5-4167-901d-3fd8d670fa19 tempest-VolumesActionsTest-1279443046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:19:21 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-5a4eb09b-afb5-4167-901d-3fd8d670fa19 tempest-VolumesActionsTest-1279443046 None] Detaching volume b4087acb-4cd7-46eb-9989-92a936d4d144 from instance 177bb9d9-2df2-4038-9739-c739798f67eb. Sep 22 11:19:21 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-5a4eb09b-afb5-4167-901d-3fd8d670fa19 tempest-VolumesActionsTest-1279443046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:19:21 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-5a4eb09b-afb5-4167-901d-3fd8d670fa19 tempest-VolumesActionsTest-1279443046 None] Detach volume completed successfully. Sep 22 11:19:21 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5a4eb09b-afb5-4167-901d-3fd8d670fa19 tempest-VolumesActionsTest-1279443046 None] Lock "cinder-b4087acb-4cd7-46eb-9989-92a936d4d144-detach_volume" released by "detach_volume" :: held 0.096s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:19:21 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5253b830-31b3-4842-b137-f1e3f9c34576 tempest-VolumesActionsTest-86593521 None] Acquiring lock "cinder-b4087acb-4cd7-46eb-9989-92a936d4d144-detach_volume" by "detach_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:19:21 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5253b830-31b3-4842-b137-f1e3f9c34576 tempest-VolumesActionsTest-86593521 None] Lock "cinder-b4087acb-4cd7-46eb-9989-92a936d4d144-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:19:21 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-5253b830-31b3-4842-b137-f1e3f9c34576 tempest-VolumesActionsTest-86593521 None] Volume detach called, but volume not attached. Sep 22 11:19:21 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5253b830-31b3-4842-b137-f1e3f9c34576 tempest-VolumesActionsTest-86593521 None] Lock "cinder-b4087acb-4cd7-46eb-9989-92a936d4d144-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:19:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] Acquiring lock "cinder-b4087acb-4cd7-46eb-9989-92a936d4d144-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:19:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] Lock "cinder-b4087acb-4cd7-46eb-9989-92a936d4d144-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:19:22 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:19:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] Acquiring lock "cinder-quobyte-b4087acb-4cd7-46eb-9989-92a936d4d144" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:19:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] Lock "cinder-quobyte-b4087acb-4cd7-46eb-9989-92a936d4d144" acquired by "delete_volume" :: waited 0.037s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:19:23 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[0744d5f1-e5ef-4571-b273-7eb4c8a12b2e]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:19:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b4087acb-4cd7-46eb-9989-92a936d4d144 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:24 devstack quobyte-client[83313]: System call of process 92717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:19:24 devstack quobyte-client[83313]: System call of process 92717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:19:24 devstack quobyte-client[83313]: System call of process 92717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:19:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b4087acb-4cd7-46eb-9989-92a936d4d144" returned: 0 in 1.859s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b4087acb-4cd7-46eb-9989-92a936d4d144 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b4087acb-4cd7-46eb-9989-92a936d4d144" returned: 0 in 0.351s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:25 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] Lock "cinder-quobyte-b4087acb-4cd7-46eb-9989-92a936d4d144" released by "delete_volume" :: held 2.846s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:19:26 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] Created reservations ['99c71f6c-d6e5-4764-9c0a-7628f3cad4e7', '8f74e17d-9a5b-48c8-a2c7-e71e47474e68', '16c3bb4a-be5c-44f4-9958-a04085c97d2f', 'b3a3166d-1f51-441e-92be-1ef51e8550de'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:19:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:19:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:19:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:19:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:19:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:19:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.350s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:26 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:19:27 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] Deleted volume successfully. Sep 22 11:19:27 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9e811e8e-cb81-40e0-a11e-b7db029446f5 tempest-VolumesActionsTest-86593521 None] Lock "cinder-b4087acb-4cd7-46eb-9989-92a936d4d144-delete_volume" released by "delete_volume" :: held 5.274s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:19:36 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=12,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:19:37 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=20,cinder:SELECT=15,cinder:DELETE=2,cinder:INSERT=4 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:19:39 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Flow 'volume_create_manager' (7fe58621-4fae-433f-8441-02d0fdfbd42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab8c7af-9ee3-4dd2-8bab-cb7c1b32b3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab8c7af-9ee3-4dd2-8bab-cb7c1b32b3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1952457300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c8b9b8-8baf-4183-82d4-6816bc91e565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d687ce1517445348be977591e4f34c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:19:39Z,use_quota=True,user_id='cdb32c39a2094872ac893da572a985de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4c6fdb-d4ac-41ed-a245-ab2c24fd7373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4c6fdb-d4ac-41ed-a245-ab2c24fd7373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b95143-b690-4002-9cb2-2a388f3e01c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b95143-b690-4002-9cb2-2a388f3e01c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4c8b9b8-8baf-4183-82d4-6816bc91e565', 'volume_name': 'volume-a4c8b9b8-8baf-4183-82d4-6816bc91e565', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a606d74-6002-4ef1-be23-9c4bcaa592d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a606d74-6002-4ef1-be23-9c4bcaa592d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e22813-77d0-4d02-aa89-bb2755f32ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:39 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Volume a4c8b9b8-8baf-4183-82d4-6816bc91e565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4c8b9b8-8baf-4183-82d4-6816bc91e565', 'volume_size': 1} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1952457300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c8b9b8-8baf-4183-82d4-6816bc91e565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d687ce1517445348be977591e4f34c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:19:39Z,use_quota=True,user_id='cdb32c39a2094872ac893da572a985de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Creating volume a4c8b9b8-8baf-4183-82d4-6816bc91e565 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:19:39 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:19:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a4c8b9b8-8baf-4183-82d4-6816bc91e565 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:39 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=69, name=volume-a4c8b9b8-8baf-4183-82d4-6816bc91e565, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:19:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a4c8b9b8-8baf-4183-82d4-6816bc91e565 1073741824" returned: 0 in 0.356s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a4c8b9b8-8baf-4183-82d4-6816bc91e565 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a4c8b9b8-8baf-4183-82d4-6816bc91e565" returned: 0 in 0.089s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] <== create_volume: return (557ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:19:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.572s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:19:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e22813-77d0-4d02-aa89-bb2755f32ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4c8b9b8-8baf-4183-82d4-6816bc91e565', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb4ad6b-b375-42b3-85ed-35146f6a8231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:40 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Volume volume-a4c8b9b8-8baf-4183-82d4-6816bc91e565 (a4c8b9b8-8baf-4183-82d4-6816bc91e565): created successfully Sep 22 11:19:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb4ad6b-b375-42b3-85ed-35146f6a8231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Flow 'volume_create_manager' (7fe58621-4fae-433f-8441-02d0fdfbd42a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:19:40 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-a441ce89-9a56-4407-b512-be97e9ccdc9e tempest-VolumesActionsTest-86593521 None] Created volume successfully. Sep 22 11:19:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] Acquiring lock "cinder-a4c8b9b8-8baf-4183-82d4-6816bc91e565-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:19:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] Lock "cinder-a4c8b9b8-8baf-4183-82d4-6816bc91e565-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:19:42 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:19:42 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] Acquiring lock "cinder-quobyte-a4c8b9b8-8baf-4183-82d4-6816bc91e565" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:19:42 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] Lock "cinder-quobyte-a4c8b9b8-8baf-4183-82d4-6816bc91e565" acquired by "delete_volume" :: waited 0.017s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:19:42 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e469e4-f7e9-4d7c-b888-73190b6dcbdb]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:19:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a4c8b9b8-8baf-4183-82d4-6816bc91e565 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:42 devstack quobyte-client[83313]: System call of process 92848 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:19:42 devstack quobyte-client[83313]: System call of process 92848 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:19:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a4c8b9b8-8baf-4183-82d4-6816bc91e565" returned: 0 in 0.557s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a4c8b9b8-8baf-4183-82d4-6816bc91e565 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a4c8b9b8-8baf-4183-82d4-6816bc91e565" returned: 0 in 0.105s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] Lock "cinder-quobyte-a4c8b9b8-8baf-4183-82d4-6816bc91e565" released by "delete_volume" :: held 0.862s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:19:43 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] Created reservations ['d40ced51-8009-4d44-897f-c617af17c730', '7da0fae8-22c4-41a2-a0bf-77d26d9b3a69', '6739fe52-b660-4d42-8d0d-c23e142004f7', 'aa3e4a34-62d9-4d7c-8946-8b1ccc71a6b6'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:19:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:19:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:19:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:19:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:19:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:19:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.102s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:43 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:19:43 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] Deleted volume successfully. Sep 22 11:19:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8d166648-6e71-4844-aa7b-c0853fc09476 tempest-VolumesActionsTest-1279443046 None] Lock "cinder-a4c8b9b8-8baf-4183-82d4-6816bc91e565-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:19:44 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Flow 'volume_create_manager' (29b650e5-67ee-42e9-a205-6efc6b943de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4583a0-1b49-4aad-b67e-3f99a3e0b477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4583a0-1b49-4aad-b67e-3f99a3e0b477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-997149216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c93dde5-fc29-40c5-a6e2-27db18174e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d687ce1517445348be977591e4f34c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:19:45Z,use_quota=True,user_id='cdb32c39a2094872ac893da572a985de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4195329b-b2f4-4b78-98fe-9399f704cd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4195329b-b2f4-4b78-98fe-9399f704cd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44100978-300e-4b1c-b9b3-b25c5d79eddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44100978-300e-4b1c-b9b3-b25c5d79eddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c93dde5-fc29-40c5-a6e2-27db18174e2a', 'volume_name': 'volume-2c93dde5-fc29-40c5-a6e2-27db18174e2a', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade03b5a-b9a2-4ef1-996b-ab70ba37f980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade03b5a-b9a2-4ef1-996b-ab70ba37f980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b736891c-2fc5-4f46-ba95-bc99065fe517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:44 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Volume 2c93dde5-fc29-40c5-a6e2-27db18174e2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c93dde5-fc29-40c5-a6e2-27db18174e2a', 'volume_size': 1} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-997149216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c93dde5-fc29-40c5-a6e2-27db18174e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d687ce1517445348be977591e4f34c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:19:45Z,use_quota=True,user_id='cdb32c39a2094872ac893da572a985de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Creating volume 2c93dde5-fc29-40c5-a6e2-27db18174e2a {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:19:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:19:44 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:19:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2c93dde5-fc29-40c5-a6e2-27db18174e2a 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:45 devstack quobyte-client[83313]: System call of process 92854 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:19:45 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=70, name=volume-2c93dde5-fc29-40c5-a6e2-27db18174e2a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:19:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2c93dde5-fc29-40c5-a6e2-27db18174e2a 1073741824" returned: 0 in 0.417s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2c93dde5-fc29-40c5-a6e2-27db18174e2a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2c93dde5-fc29-40c5-a6e2-27db18174e2a" returned: 0 in 0.142s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:45 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] <== create_volume: return (626ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:19:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.639s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:19:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b736891c-2fc5-4f46-ba95-bc99065fe517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c93dde5-fc29-40c5-a6e2-27db18174e2a', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41bf5535-30c8-417f-bacd-b0c5d202c6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:45 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Volume volume-2c93dde5-fc29-40c5-a6e2-27db18174e2a (2c93dde5-fc29-40c5-a6e2-27db18174e2a): created successfully Sep 22 11:19:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41bf5535-30c8-417f-bacd-b0c5d202c6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Flow 'volume_create_manager' (29b650e5-67ee-42e9-a205-6efc6b943de9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:19:45 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-629afde3-cc39-42de-991b-8959d6208c6f tempest-VolumesActionsTest-86593521 None] Created volume successfully. Sep 22 11:19:47 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] Acquiring lock "cinder-2c93dde5-fc29-40c5-a6e2-27db18174e2a-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:19:47 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] Lock "cinder-2c93dde5-fc29-40c5-a6e2-27db18174e2a-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:19:47 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:19:47 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] Acquiring lock "cinder-quobyte-2c93dde5-fc29-40c5-a6e2-27db18174e2a" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:19:47 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] Lock "cinder-quobyte-2c93dde5-fc29-40c5-a6e2-27db18174e2a" acquired by "delete_volume" :: waited 0.018s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:19:47 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f717f040-2732-4947-9c10-f79ecaf78415]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:19:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2c93dde5-fc29-40c5-a6e2-27db18174e2a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:48 devstack quobyte-client[83313]: System call of process 92858 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:19:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2c93dde5-fc29-40c5-a6e2-27db18174e2a" returned: 0 in 0.467s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2c93dde5-fc29-40c5-a6e2-27db18174e2a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2c93dde5-fc29-40c5-a6e2-27db18174e2a" returned: 0 in 0.107s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] Lock "cinder-quobyte-2c93dde5-fc29-40c5-a6e2-27db18174e2a" released by "delete_volume" :: held 0.797s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:19:48 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] Created reservations ['dafbf930-8df3-4f68-b33d-2f56e8b726bf', 'a565a269-ae63-49eb-a046-9aacd03b1665', 'dbdb2ce4-5ef4-4600-8a46-1576c2f645b8', 'c8dee52b-7908-496e-8c48-38b2ee4ed4da'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:19:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:19:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:19:48 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:19:48 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:19:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:19:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.111s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:48 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:19:49 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] Deleted volume successfully. Sep 22 11:19:49 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-684b3587-c6f3-4341-919f-7041854534c3 tempest-VolumesActionsTest-1279443046 None] Lock "cinder-2c93dde5-fc29-40c5-a6e2-27db18174e2a-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:19:50 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Flow 'volume_create_manager' (2d89f970-e6da-428b-9ab3-0fa4f959d7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95f4504-578c-418a-8a43-1790c3a2f0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95f4504-578c-418a-8a43-1790c3a2f0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1909708111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da06f93-bf88-477d-bb8d-40b35764e41e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d687ce1517445348be977591e4f34c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:19:50Z,use_quota=True,user_id='cdb32c39a2094872ac893da572a985de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4fdc62-7eb6-4360-9bc5-39480eb8910f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4fdc62-7eb6-4360-9bc5-39480eb8910f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fedce4c-123c-48ba-93b6-5f265d6b5b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fedce4c-123c-48ba-93b6-5f265d6b5b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3da06f93-bf88-477d-bb8d-40b35764e41e', 'volume_name': 'volume-3da06f93-bf88-477d-bb8d-40b35764e41e', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97949b0d-7911-43e8-af64-195cbd3cc2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97949b0d-7911-43e8-af64-195cbd3cc2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1390377-c266-4822-b9ca-e868c7c97732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:50 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Volume 3da06f93-bf88-477d-bb8d-40b35764e41e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3da06f93-bf88-477d-bb8d-40b35764e41e', 'volume_size': 1} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1909708111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da06f93-bf88-477d-bb8d-40b35764e41e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d687ce1517445348be977591e4f34c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:19:50Z,use_quota=True,user_id='cdb32c39a2094872ac893da572a985de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Creating volume 3da06f93-bf88-477d-bb8d-40b35764e41e {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:19:50 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:19:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3da06f93-bf88-477d-bb8d-40b35764e41e 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:50 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=71, name=volume-3da06f93-bf88-477d-bb8d-40b35764e41e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:19:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3da06f93-bf88-477d-bb8d-40b35764e41e 1073741824" returned: 0 in 0.575s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3da06f93-bf88-477d-bb8d-40b35764e41e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3da06f93-bf88-477d-bb8d-40b35764e41e" returned: 0 in 0.157s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] <== create_volume: return (838ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:19:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:19:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1390377-c266-4822-b9ca-e868c7c97732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3da06f93-bf88-477d-bb8d-40b35764e41e', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6532cda-748e-4e73-9fb2-ca320cb00496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:51 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Volume volume-3da06f93-bf88-477d-bb8d-40b35764e41e (3da06f93-bf88-477d-bb8d-40b35764e41e): created successfully Sep 22 11:19:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6532cda-748e-4e73-9fb2-ca320cb00496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Flow 'volume_create_manager' (2d89f970-e6da-428b-9ab3-0fa4f959d7c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:19:51 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-02fcb2da-c433-4fd7-98b0-1a832daab36b tempest-VolumesActionsTest-86593521 None] Created volume successfully. Sep 22 11:19:52 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] Acquiring lock "cinder-3da06f93-bf88-477d-bb8d-40b35764e41e-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:19:53 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] Lock "cinder-3da06f93-bf88-477d-bb8d-40b35764e41e-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:19:53 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:19:53 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] Acquiring lock "cinder-quobyte-3da06f93-bf88-477d-bb8d-40b35764e41e" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:19:53 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] Lock "cinder-quobyte-3da06f93-bf88-477d-bb8d-40b35764e41e" acquired by "delete_volume" :: waited 0.013s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:19:53 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c950f1f-3d21-4014-9ce8-fc88f3d6a64e]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:19:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3da06f93-bf88-477d-bb8d-40b35764e41e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:53 devstack quobyte-client[83313]: System call of process 92867 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:19:53 devstack quobyte-client[83313]: System call of process 92867 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:19:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3da06f93-bf88-477d-bb8d-40b35764e41e" returned: 0 in 0.620s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3da06f93-bf88-477d-bb8d-40b35764e41e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3da06f93-bf88-477d-bb8d-40b35764e41e" returned: 0 in 0.140s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] Lock "cinder-quobyte-3da06f93-bf88-477d-bb8d-40b35764e41e" released by "delete_volume" :: held 0.958s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:19:54 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] Created reservations ['5b924af2-2ff2-419a-b8d2-b64374c154b2', 'cb6c2cf0-bd5c-4f19-b4fe-621f45735d10', '3245e0f9-e491-48dd-bc6c-de79d247b68f', 'afb0266b-07c2-4499-9cf0-f6a7eafcac9e'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:19:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:19:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:19:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:19:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:19:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:19:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.102s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:54 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:19:54 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] Deleted volume successfully. Sep 22 11:19:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b8df84cc-1353-4be8-af0c-3bf14645b53b tempest-VolumesActionsTest-1279443046 None] Lock "cinder-3da06f93-bf88-477d-bb8d-40b35764e41e-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:19:55 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:19:55 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:19:55 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Flow 'volume_create_manager' (12298fe8-c77e-4d60-a7f7-bcadbae77875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:19:55 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e73311-f763-47dc-bb84-bcbcf4f2a532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e73311-f763-47dc-bb84-bcbcf4f2a532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1455478253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea05049a-1055-4218-be00-09ff9b406e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d687ce1517445348be977591e4f34c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:19:56Z,use_quota=True,user_id='cdb32c39a2094872ac893da572a985de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915898e2-1995-4969-bd6b-9251b43f4c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915898e2-1995-4969-bd6b-9251b43f4c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2562730e-b32b-4e0e-ba79-58505f1594d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2562730e-b32b-4e0e-ba79-58505f1594d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea05049a-1055-4218-be00-09ff9b406e62', 'volume_name': 'volume-ea05049a-1055-4218-be00-09ff9b406e62', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d11e54-cf12-4710-bd29-3710bd44f421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d11e54-cf12-4710-bd29-3710bd44f421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216a001f-8b9d-4be1-9abb-36c8739e2cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:56 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Volume ea05049a-1055-4218-be00-09ff9b406e62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea05049a-1055-4218-be00-09ff9b406e62', 'volume_size': 1} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1455478253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea05049a-1055-4218-be00-09ff9b406e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d687ce1517445348be977591e4f34c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:19:56Z,use_quota=True,user_id='cdb32c39a2094872ac893da572a985de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Creating volume ea05049a-1055-4218-be00-09ff9b406e62 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:19:56 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ea05049a-1055-4218-be00-09ff9b406e62 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:56 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=72, name=volume-ea05049a-1055-4218-be00-09ff9b406e62, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ea05049a-1055-4218-be00-09ff9b406e62 1073741824" returned: 0 in 0.391s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ea05049a-1055-4218-be00-09ff9b406e62 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ea05049a-1055-4218-be00-09ff9b406e62" returned: 0 in 0.091s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] <== create_volume: return (556ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.569s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216a001f-8b9d-4be1-9abb-36c8739e2cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea05049a-1055-4218-be00-09ff9b406e62', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697c55be-6d08-4435-8d4d-f69e0970df39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:19:56 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Volume volume-ea05049a-1055-4218-be00-09ff9b406e62 (ea05049a-1055-4218-be00-09ff9b406e62): created successfully Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697c55be-6d08-4435-8d4d-f69e0970df39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:19:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Flow 'volume_create_manager' (12298fe8-c77e-4d60-a7f7-bcadbae77875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:19:56 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-a3b02e17-d672-4f05-bfed-e155d9495e6c tempest-VolumesActionsTest-86593521 None] Created volume successfully. Sep 22 11:19:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] Acquiring lock "cinder-ea05049a-1055-4218-be00-09ff9b406e62-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:19:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] Lock "cinder-ea05049a-1055-4218-be00-09ff9b406e62-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:19:58 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:19:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] Acquiring lock "cinder-quobyte-ea05049a-1055-4218-be00-09ff9b406e62" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:19:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] Lock "cinder-quobyte-ea05049a-1055-4218-be00-09ff9b406e62" acquired by "delete_volume" :: waited 0.015s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:19:58 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c4a977-9fc4-4805-84d1-4d316a54d2f0]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:19:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ea05049a-1055-4218-be00-09ff9b406e62 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ea05049a-1055-4218-be00-09ff9b406e62" returned: 0 in 0.439s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ea05049a-1055-4218-be00-09ff9b406e62 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ea05049a-1055-4218-be00-09ff9b406e62" returned: 0 in 0.109s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] Lock "cinder-quobyte-ea05049a-1055-4218-be00-09ff9b406e62" released by "delete_volume" :: held 0.698s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:19:59 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] Created reservations ['9aff4206-d7fa-4fc5-a942-99fe15d6efad', '096a829a-c579-4c73-bf2c-4b202a026f77', '4661b90e-03ca-499a-b987-581529a7d9cd', '462c4439-ef0b-409f-956a-f6cb176d0030'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:19:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:19:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:19:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:19:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:19:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:19:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:19:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.117s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:19:59 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:19:59 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] Deleted volume successfully. Sep 22 11:19:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-bf1e1c89-1f67-49dd-a79a-ecb8764eeffc tempest-VolumesActionsTest-1279443046 None] Lock "cinder-ea05049a-1055-4218-be00-09ff9b406e62-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:20:01 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Flow 'volume_create_manager' (a47903a3-c3dd-4bf6-bde9-ffbe3b861577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c67228-20fc-4c3c-8474-567b89861975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c67228-20fc-4c3c-8474-567b89861975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-754157450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50c166e-a127-4815-b32d-61b3d00ce105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d687ce1517445348be977591e4f34c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:20:01Z,use_quota=True,user_id='cdb32c39a2094872ac893da572a985de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2a11b9-9d5a-4a91-bae4-5f3cd5e031c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2a11b9-9d5a-4a91-bae4-5f3cd5e031c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c1d7f01-bb91-4ef6-8520-b6baf7b97543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c1d7f01-bb91-4ef6-8520-b6baf7b97543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f50c166e-a127-4815-b32d-61b3d00ce105', 'volume_name': 'volume-f50c166e-a127-4815-b32d-61b3d00ce105', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d48694-1c38-49dd-8c5e-4b7ab9b31430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d48694-1c38-49dd-8c5e-4b7ab9b31430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50063ad-de3b-4ab2-b081-a63e9d35cdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:01 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Volume f50c166e-a127-4815-b32d-61b3d00ce105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f50c166e-a127-4815-b32d-61b3d00ce105', 'volume_size': 1} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-754157450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50c166e-a127-4815-b32d-61b3d00ce105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d687ce1517445348be977591e4f34c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:20:01Z,use_quota=True,user_id='cdb32c39a2094872ac893da572a985de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Creating volume f50c166e-a127-4815-b32d-61b3d00ce105 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:20:01 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f50c166e-a127-4815-b32d-61b3d00ce105 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:01 devstack quobyte-client[83313]: System call of process 92895 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:20:01 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=73, name=volume-f50c166e-a127-4815-b32d-61b3d00ce105, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f50c166e-a127-4815-b32d-61b3d00ce105 1073741824" returned: 0 in 0.382s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f50c166e-a127-4815-b32d-61b3d00ce105 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f50c166e-a127-4815-b32d-61b3d00ce105" returned: 0 in 0.136s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] <== create_volume: return (582ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:20:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.595s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:02 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50063ad-de3b-4ab2-b081-a63e9d35cdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f50c166e-a127-4815-b32d-61b3d00ce105', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:02 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0439dffa-c85a-42e2-826c-13d44a58df91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:02 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Volume volume-f50c166e-a127-4815-b32d-61b3d00ce105 (f50c166e-a127-4815-b32d-61b3d00ce105): created successfully Sep 22 11:20:02 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0439dffa-c85a-42e2-826c-13d44a58df91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:02 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Flow 'volume_create_manager' (a47903a3-c3dd-4bf6-bde9-ffbe3b861577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:20:02 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-c393f264-6d1d-4ddd-ac08-60cef690ad9b tempest-VolumesActionsTest-86593521 None] Created volume successfully. Sep 22 11:20:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] Acquiring lock "cinder-f50c166e-a127-4815-b32d-61b3d00ce105-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:20:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] Lock "cinder-f50c166e-a127-4815-b32d-61b3d00ce105-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:20:04 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:20:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] Acquiring lock "cinder-quobyte-f50c166e-a127-4815-b32d-61b3d00ce105" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:20:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] Lock "cinder-quobyte-f50c166e-a127-4815-b32d-61b3d00ce105" acquired by "delete_volume" :: waited 0.017s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:20:04 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[88934d83-1410-4165-9b65-a75dc1bc3b13]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:20:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f50c166e-a127-4815-b32d-61b3d00ce105 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:04 devstack quobyte-client[83313]: System call of process 92924 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:20:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f50c166e-a127-4815-b32d-61b3d00ce105" returned: 0 in 0.449s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f50c166e-a127-4815-b32d-61b3d00ce105 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f50c166e-a127-4815-b32d-61b3d00ce105" returned: 0 in 0.127s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] Lock "cinder-quobyte-f50c166e-a127-4815-b32d-61b3d00ce105" released by "delete_volume" :: held 0.742s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:20:05 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] Created reservations ['5f0ac95f-21f7-405e-a81a-2274ca72ac0e', '13b87a0d-e634-4f7c-beaf-0553459c0269', '12b67845-d327-4905-899f-1b9cf7eb5a8b', 'ead49116-c5e6-44af-af48-43690a5b6817'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:20:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:05 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:20:05 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:20:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.120s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:05 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:20:05 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] Deleted volume successfully. Sep 22 11:20:05 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6260fa47-6c22-4c5b-a51b-3d5818fe8454 tempest-VolumesActionsTest-86593521 None] Lock "cinder-f50c166e-a127-4815-b32d-61b3d00ce105-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:20:15 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=33,cinder:UPDATE=57,cinder:INSERT=16,cinder:DELETE=4 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:20:15 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=44,cinder:SELECT=28,cinder:DELETE=6,cinder:INSERT=4 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:20:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:20:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:20:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:20:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.236s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:20:24 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Flow 'volume_create_manager' (7083dee6-7204-44f7-b006-550ca8121989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35352faa-0ebd-40f6-b403-0c85aa9a5dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35352faa-0ebd-40f6-b403-0c85aa9a5dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-732365010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3634fe65-cae0-4cd5-99cb-0b866852635e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79193b35d7e942dda49d9c0ea29e8299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:20:24Z,use_quota=True,user_id='9910137829174e25a3bbf6cfb87d4d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d2ab82-29f4-4786-8031-4d1d0eb6d75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d2ab82-29f4-4786-8031-4d1d0eb6d75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9adbee-ffc9-4fb1-998f-76536a0ac401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9adbee-ffc9-4fb1-998f-76536a0ac401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3634fe65-cae0-4cd5-99cb-0b866852635e', 'volume_name': 'volume-3634fe65-cae0-4cd5-99cb-0b866852635e', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9689a92-72fc-4123-968c-871bd9f8434d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9689a92-72fc-4123-968c-871bd9f8434d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b334cc-2618-461d-a840-537d6e672f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:24 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Volume 3634fe65-cae0-4cd5-99cb-0b866852635e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3634fe65-cae0-4cd5-99cb-0b866852635e', 'volume_size': 1} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-732365010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3634fe65-cae0-4cd5-99cb-0b866852635e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79193b35d7e942dda49d9c0ea29e8299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:20:24Z,use_quota=True,user_id='9910137829174e25a3bbf6cfb87d4d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Creating volume 3634fe65-cae0-4cd5-99cb-0b866852635e {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:20:24 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3634fe65-cae0-4cd5-99cb-0b866852635e 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:24 devstack quobyte-client[83313]: System call of process 92953 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:20:24 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=74, name=volume-3634fe65-cae0-4cd5-99cb-0b866852635e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3634fe65-cae0-4cd5-99cb-0b866852635e 1073741824" returned: 0 in 0.370s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3634fe65-cae0-4cd5-99cb-0b866852635e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3634fe65-cae0-4cd5-99cb-0b866852635e" returned: 0 in 0.103s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] <== create_volume: return (548ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.561s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b334cc-2618-461d-a840-537d6e672f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3634fe65-cae0-4cd5-99cb-0b866852635e', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1db9c9b-97ce-4fbd-ad20-a0b7746c918a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:24 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Volume volume-3634fe65-cae0-4cd5-99cb-0b866852635e (3634fe65-cae0-4cd5-99cb-0b866852635e): created successfully Sep 22 11:20:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1db9c9b-97ce-4fbd-ad20-a0b7746c918a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Flow 'volume_create_manager' (7083dee6-7204-44f7-b006-550ca8121989) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:20:25 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-276ef272-95fc-4613-bb24-ee6b034f9cd1 tempest-VolumesListAdminTestJSON-731960573 None] Created volume successfully. Sep 22 11:20:26 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Flow 'volume_create_manager' (d937296e-cb4c-4f21-97cf-674dee3655e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6778c180-da69-494b-a3df-4308ee4ae680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6778c180-da69-494b-a3df-4308ee4ae680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-23874123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49fb35f-b3f1-4e15-afb4-0036560f8bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79193b35d7e942dda49d9c0ea29e8299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:20:26Z,use_quota=True,user_id='9910137829174e25a3bbf6cfb87d4d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eaac2ad-4428-4be2-9641-f12acc6ccf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eaac2ad-4428-4be2-9641-f12acc6ccf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db42f803-b6ef-4fe1-8bf1-d27434513a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db42f803-b6ef-4fe1-8bf1-d27434513a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c49fb35f-b3f1-4e15-afb4-0036560f8bcd', 'volume_name': 'volume-c49fb35f-b3f1-4e15-afb4-0036560f8bcd', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45a632a-6f65-4538-8a80-2ced178e4996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45a632a-6f65-4538-8a80-2ced178e4996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c38477-7f1d-4278-ba21-7b6667d1916f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:26 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Volume c49fb35f-b3f1-4e15-afb4-0036560f8bcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c49fb35f-b3f1-4e15-afb4-0036560f8bcd', 'volume_size': 1} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-23874123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49fb35f-b3f1-4e15-afb4-0036560f8bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79193b35d7e942dda49d9c0ea29e8299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:20:26Z,use_quota=True,user_id='9910137829174e25a3bbf6cfb87d4d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Creating volume c49fb35f-b3f1-4e15-afb4-0036560f8bcd {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:20:26 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:20:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c49fb35f-b3f1-4e15-afb4-0036560f8bcd 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:26 devstack quobyte-client[83313]: System call of process 92959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:20:26 devstack quobyte-client[83313]: System call of process 92959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:20:26 devstack quobyte-client[83313]: System call of process 92959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:20:26 devstack quobyte-client[83313]: System call of process 92959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:20:26 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=75, name=volume-c49fb35f-b3f1-4e15-afb4-0036560f8bcd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:20:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c49fb35f-b3f1-4e15-afb4-0036560f8bcd 1073741824" returned: 0 in 0.393s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c49fb35f-b3f1-4e15-afb4-0036560f8bcd {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c49fb35f-b3f1-4e15-afb4-0036560f8bcd" returned: 0 in 0.093s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] <== create_volume: return (569ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:20:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.582s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c38477-7f1d-4278-ba21-7b6667d1916f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c49fb35f-b3f1-4e15-afb4-0036560f8bcd', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c01cc39-aaf0-458a-8a3e-bbb5afc63463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:27 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Volume volume-c49fb35f-b3f1-4e15-afb4-0036560f8bcd (c49fb35f-b3f1-4e15-afb4-0036560f8bcd): created successfully Sep 22 11:20:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c01cc39-aaf0-458a-8a3e-bbb5afc63463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Flow 'volume_create_manager' (d937296e-cb4c-4f21-97cf-674dee3655e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:20:27 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-93b308cf-8409-4c51-8c09-07789ccfdcaa tempest-VolumesListAdminTestJSON-731960573 None] Created volume successfully. Sep 22 11:20:29 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Flow 'volume_create_manager' (388f5f6d-ad4c-4111-ad3f-2a8e3b688c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a90598-c5b3-4edc-a1d9-a65777a57f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a90598-c5b3-4edc-a1d9-a65777a57f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1720785811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0517afc4-c24f-4098-9fde-88e06bcf015c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79193b35d7e942dda49d9c0ea29e8299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:20:29Z,use_quota=True,user_id='9910137829174e25a3bbf6cfb87d4d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2700c4-1c2c-4ed8-9a3a-d044afdd8e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2700c4-1c2c-4ed8-9a3a-d044afdd8e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913f9e10-d693-4295-b896-4e0bfcfb336c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913f9e10-d693-4295-b896-4e0bfcfb336c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0517afc4-c24f-4098-9fde-88e06bcf015c', 'volume_name': 'volume-0517afc4-c24f-4098-9fde-88e06bcf015c', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95dc28f4-8452-485a-83a6-189c0b15e754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95dc28f4-8452-485a-83a6-189c0b15e754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1549c240-653a-44fb-b3d5-a8cc399b5a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:29 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Volume 0517afc4-c24f-4098-9fde-88e06bcf015c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0517afc4-c24f-4098-9fde-88e06bcf015c', 'volume_size': 1} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1720785811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0517afc4-c24f-4098-9fde-88e06bcf015c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79193b35d7e942dda49d9c0ea29e8299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:20:29Z,use_quota=True,user_id='9910137829174e25a3bbf6cfb87d4d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Creating volume 0517afc4-c24f-4098-9fde-88e06bcf015c {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:20:29 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0517afc4-c24f-4098-9fde-88e06bcf015c 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:29 devstack quobyte-client[83313]: System call of process 92964 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:20:29 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=76, name=volume-0517afc4-c24f-4098-9fde-88e06bcf015c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0517afc4-c24f-4098-9fde-88e06bcf015c 1073741824" returned: 0 in 0.362s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0517afc4-c24f-4098-9fde-88e06bcf015c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0517afc4-c24f-4098-9fde-88e06bcf015c" returned: 0 in 0.131s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] <== create_volume: return (567ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:20:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.580s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1549c240-653a-44fb-b3d5-a8cc399b5a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0517afc4-c24f-4098-9fde-88e06bcf015c', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22eab0dc-abdf-41f9-89d4-3d9a97bcb44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:30 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Volume volume-0517afc4-c24f-4098-9fde-88e06bcf015c (0517afc4-c24f-4098-9fde-88e06bcf015c): created successfully Sep 22 11:20:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22eab0dc-abdf-41f9-89d4-3d9a97bcb44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Flow 'volume_create_manager' (388f5f6d-ad4c-4111-ad3f-2a8e3b688c01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:20:30 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-6c43b14b-3830-44a1-bbdd-c3a2aefc1141 tempest-VolumesListAdminTestJSON-731960573 None] Created volume successfully. Sep 22 11:20:32 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Flow 'volume_create_manager' (7dd6b75b-e811-47db-aa18-7f8932505d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b116a47-64f4-4b97-8b99-0d69545cf050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b116a47-64f4-4b97-8b99-0d69545cf050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c40b2aa-675a-4103-bfb4-afaa533eb45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='519236224eb9463da500f8091d760b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:20:32Z,use_quota=True,user_id='bcc12a5b8cde40b58075b564df507420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22040d79-6a4c-4f75-8f5c-a64603fa9260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22040d79-6a4c-4f75-8f5c-a64603fa9260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c894b79e-40f4-4e99-a392-6cae762089f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c894b79e-40f4-4e99-a392-6cae762089f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c40b2aa-675a-4103-bfb4-afaa533eb45c', 'volume_name': 'volume-5c40b2aa-675a-4103-bfb4-afaa533eb45c', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82635a3e-ab97-4de0-a9e2-41f387385c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82635a3e-ab97-4de0-a9e2-41f387385c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5186bce6-4490-49d2-8154-73bf45ccf0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:32 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Volume 5c40b2aa-675a-4103-bfb4-afaa533eb45c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c40b2aa-675a-4103-bfb4-afaa533eb45c', 'volume_size': 1} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c40b2aa-675a-4103-bfb4-afaa533eb45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='519236224eb9463da500f8091d760b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:20:32Z,use_quota=True,user_id='bcc12a5b8cde40b58075b564df507420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Creating volume 5c40b2aa-675a-4103-bfb4-afaa533eb45c {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:20:32 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:20:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5c40b2aa-675a-4103-bfb4-afaa533eb45c 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:33 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=77, name=volume-5c40b2aa-675a-4103-bfb4-afaa533eb45c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:20:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5c40b2aa-675a-4103-bfb4-afaa533eb45c 1073741824" returned: 0 in 0.790s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5c40b2aa-675a-4103-bfb4-afaa533eb45c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5c40b2aa-675a-4103-bfb4-afaa533eb45c" returned: 0 in 0.221s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:33 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] <== create_volume: return (1185ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:20:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5186bce6-4490-49d2-8154-73bf45ccf0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c40b2aa-675a-4103-bfb4-afaa533eb45c', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86e81d6-a8c4-4425-9097-317540051c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:34 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Volume volume-5c40b2aa-675a-4103-bfb4-afaa533eb45c (5c40b2aa-675a-4103-bfb4-afaa533eb45c): created successfully Sep 22 11:20:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86e81d6-a8c4-4425-9097-317540051c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Flow 'volume_create_manager' (7dd6b75b-e811-47db-aa18-7f8932505d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:20:34 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-8abbdb2c-ad8f-49cf-906e-9f32ca83956c tempest-VolumesListAdminTestJSON-1517765047 None] Created volume successfully. Sep 22 11:20:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] Acquiring lock "cinder-5c40b2aa-675a-4103-bfb4-afaa533eb45c-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:20:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] Lock "cinder-5c40b2aa-675a-4103-bfb4-afaa533eb45c-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:20:34 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:20:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] Acquiring lock "cinder-quobyte-5c40b2aa-675a-4103-bfb4-afaa533eb45c" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:20:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] Acquiring lock "cinder-0517afc4-c24f-4098-9fde-88e06bcf015c-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:20:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] Lock "cinder-quobyte-5c40b2aa-675a-4103-bfb4-afaa533eb45c" acquired by "delete_volume" :: waited 0.076s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:20:34 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6ce391-2956-4955-8fc9-f73532dd690b]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:20:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] Lock "cinder-0517afc4-c24f-4098-9fde-88e06bcf015c-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:20:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5c40b2aa-675a-4103-bfb4-afaa533eb45c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:35 devstack quobyte-client[83313]: System call of process 93016 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:20:35 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:20:35 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] Acquiring lock "cinder-quobyte-0517afc4-c24f-4098-9fde-88e06bcf015c" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:20:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5c40b2aa-675a-4103-bfb4-afaa533eb45c" returned: 0 in 0.743s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5c40b2aa-675a-4103-bfb4-afaa533eb45c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:35 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] Lock "cinder-quobyte-0517afc4-c24f-4098-9fde-88e06bcf015c" acquired by "delete_volume" :: waited 0.282s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:20:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5c40b2aa-675a-4103-bfb4-afaa533eb45c" returned: 0 in 0.316s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:36 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[181266ee-271f-4bca-9179-2addfdbc695c]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:20:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0517afc4-c24f-4098-9fde-88e06bcf015c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:36 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] Lock "cinder-quobyte-5c40b2aa-675a-4103-bfb4-afaa533eb45c" released by "delete_volume" :: held 1.287s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:20:36 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] Created reservations ['37252de7-08fc-4661-82ba-0b6a3c2811c1', 'e50eb5ae-1ce9-40ae-abed-7cec303a7a5f', '7be4a35d-764a-4710-a32c-80e5da6cb1d7', '353ee404-0a7c-4eda-9ed3-33ef64b43591'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:20:36 devstack quobyte-client[83313]: System call of process 93020 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:20:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0517afc4-c24f-4098-9fde-88e06bcf015c" returned: 0 in 0.659s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0517afc4-c24f-4098-9fde-88e06bcf015c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:20:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:20:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0517afc4-c24f-4098-9fde-88e06bcf015c" returned: 0 in 0.315s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:37 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] Lock "cinder-quobyte-0517afc4-c24f-4098-9fde-88e06bcf015c" released by "delete_volume" :: held 1.237s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:20:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.416s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:37 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:20:37 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] Deleted volume successfully. Sep 22 11:20:37 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f0c7506d-7a6e-4ac3-8a27-12bfe1f50431 tempest-VolumesListAdminTestJSON-1517765047 None] Lock "cinder-5c40b2aa-675a-4103-bfb4-afaa533eb45c-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:20:37 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] Created reservations ['8edc79f9-19bf-4ffe-b777-bce980a0e471', '7e18a2fa-950a-4bb4-a3bc-bfd3f5921989', 'ff35f0a6-7453-4f33-b418-5296a09adf10', '6c3c5373-08c4-4a02-90e7-78f06f9b4be2'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:20:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:20:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:20:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.110s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:37 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:20:38 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] Deleted volume successfully. Sep 22 11:20:38 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-45bfb494-ddef-45ed-9065-216e0f9e7477 tempest-VolumesListAdminTestJSON-731960573 None] Lock "cinder-0517afc4-c24f-4098-9fde-88e06bcf015c-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:20:38 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] Acquiring lock "cinder-c49fb35f-b3f1-4e15-afb4-0036560f8bcd-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:20:38 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] Lock "cinder-c49fb35f-b3f1-4e15-afb4-0036560f8bcd-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:20:38 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:20:38 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] Acquiring lock "cinder-quobyte-c49fb35f-b3f1-4e15-afb4-0036560f8bcd" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:20:38 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] Lock "cinder-quobyte-c49fb35f-b3f1-4e15-afb4-0036560f8bcd" acquired by "delete_volume" :: waited 0.017s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:20:38 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06c656c-0f92-4711-b6de-d180178e27b3]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:20:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c49fb35f-b3f1-4e15-afb4-0036560f8bcd {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:39 devstack quobyte-client[83313]: System call of process 93026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:20:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c49fb35f-b3f1-4e15-afb4-0036560f8bcd" returned: 0 in 0.482s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c49fb35f-b3f1-4e15-afb4-0036560f8bcd {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c49fb35f-b3f1-4e15-afb4-0036560f8bcd" returned: 0 in 0.093s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] Lock "cinder-quobyte-c49fb35f-b3f1-4e15-afb4-0036560f8bcd" released by "delete_volume" :: held 0.738s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:20:39 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] Created reservations ['41da1187-54ca-41f1-978c-c06a8c44e4e0', 'a5baed5a-4510-4daf-975f-90fd24c88543', '5266f3d4-31e7-4094-82a8-a7ec64dd4864', 'f874aa0d-9e90-4fd2-870e-4c5983a5fd05'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:20:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:20:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:20:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.111s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:20:40 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] Deleted volume successfully. Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4da7ad80-0ffa-45ba-9bbd-66864561b489 tempest-VolumesListAdminTestJSON-731960573 None] Lock "cinder-c49fb35f-b3f1-4e15-afb4-0036560f8bcd-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:20:40 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Flow 'volume_create_manager' (003f8089-fcf6-4e4b-afbc-e14d74ac3442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f83a04-5023-4d79-915c-2aff0d08110a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f83a04-5023-4d79-915c-2aff0d08110a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-339558088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d9ef29-6e98-4472-bfe6-1310a2bfff58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839c8213b56a45ccb63853de8a29eed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:20:40Z,use_quota=True,user_id='d5d28ef8ea4a48b6bca56ef8ece2b2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1271119-be65-45d4-baf6-11904c25015f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1271119-be65-45d4-baf6-11904c25015f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dec4629-bc93-4760-ab27-881650820c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dec4629-bc93-4760-ab27-881650820c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08d9ef29-6e98-4472-bfe6-1310a2bfff58', 'volume_name': 'volume-08d9ef29-6e98-4472-bfe6-1310a2bfff58', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3702c81e-ce72-4a28-b99f-80c36414b8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3702c81e-ce72-4a28-b99f-80c36414b8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba8bfc9-4447-4d53-9237-bb75bbfc3306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:40 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Volume 08d9ef29-6e98-4472-bfe6-1310a2bfff58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08d9ef29-6e98-4472-bfe6-1310a2bfff58', 'volume_size': 1} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-339558088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d9ef29-6e98-4472-bfe6-1310a2bfff58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839c8213b56a45ccb63853de8a29eed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:20:40Z,use_quota=True,user_id='d5d28ef8ea4a48b6bca56ef8ece2b2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Creating volume 08d9ef29-6e98-4472-bfe6-1310a2bfff58 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:20:40 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-08d9ef29-6e98-4472-bfe6-1310a2bfff58 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:40 devstack quobyte-client[83313]: System call of process 93033 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:20:40 devstack quobyte-client[83313]: System call of process 93033 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:20:40 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=78, name=volume-08d9ef29-6e98-4472-bfe6-1310a2bfff58, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:20:40 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] Acquiring lock "cinder-3634fe65-cae0-4cd5-99cb-0b866852635e-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:20:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] Lock "cinder-3634fe65-cae0-4cd5-99cb-0b866852635e-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:20:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-08d9ef29-6e98-4472-bfe6-1310a2bfff58 1073741824" returned: 0 in 0.513s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-08d9ef29-6e98-4472-bfe6-1310a2bfff58 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-08d9ef29-6e98-4472-bfe6-1310a2bfff58" returned: 0 in 0.278s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] <== create_volume: return (823ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:20:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:41 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:20:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] Acquiring lock "cinder-quobyte-3634fe65-cae0-4cd5-99cb-0b866852635e" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:20:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba8bfc9-4447-4d53-9237-bb75bbfc3306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08d9ef29-6e98-4472-bfe6-1310a2bfff58', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (970fc2f5-6ead-4fe9-9b4a-c2812b562468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] Lock "cinder-quobyte-3634fe65-cae0-4cd5-99cb-0b866852635e" acquired by "delete_volume" :: waited 0.091s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:20:41 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Volume volume-08d9ef29-6e98-4472-bfe6-1310a2bfff58 (08d9ef29-6e98-4472-bfe6-1310a2bfff58): created successfully Sep 22 11:20:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (970fc2f5-6ead-4fe9-9b4a-c2812b562468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Flow 'volume_create_manager' (003f8089-fcf6-4e4b-afbc-e14d74ac3442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:20:41 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2eb5d2-0703-4b16-ae4c-abe240615a35]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:20:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3634fe65-cae0-4cd5-99cb-0b866852635e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:41 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-2f3e4dc5-4073-4f01-9a34-6c1c6dd81c08 tempest-AttachVolumeNegativeTest-524744203 None] Created volume successfully. Sep 22 11:20:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3634fe65-cae0-4cd5-99cb-0b866852635e" returned: 0 in 0.505s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3634fe65-cae0-4cd5-99cb-0b866852635e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3634fe65-cae0-4cd5-99cb-0b866852635e" returned: 0 in 0.087s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:42 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] Lock "cinder-quobyte-3634fe65-cae0-4cd5-99cb-0b866852635e" released by "delete_volume" :: held 0.764s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:20:42 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] Created reservations ['b0891a32-ce1f-4257-8af8-db244ac6ae4e', 'f1e1d4d6-1a1c-4b70-b2ad-8af66ee6386e', '761ec1b6-c60b-4658-ace1-4aff4ced9a1e', 'f61ff976-30df-4246-9b85-8f1fa1d1f058'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:20:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:42 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:20:42 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:20:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.087s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:43 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:20:43 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] Deleted volume successfully. Sep 22 11:20:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b064875b-1ed6-4b06-bf5e-9439f4e096e4 tempest-VolumesListAdminTestJSON-731960573 None] Lock "cinder-3634fe65-cae0-4cd5-99cb-0b866852635e-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:20:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-91633556-8fcb-4a18-9c83-bdbb3c512709 req-130e54b6-6399-4c4b-9f05-7ded30c70922 tempest-AttachVolumeNegativeTest-524744203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-91633556-8fcb-4a18-9c83-bdbb3c512709 req-130e54b6-6399-4c4b-9f05-7ded30c70922 tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:46 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5eb24d1-baaa-4919-9b2d-ab62c74a5b1c]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:20:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-91633556-8fcb-4a18-9c83-bdbb3c512709 req-130e54b6-6399-4c4b-9f05-7ded30c70922 tempest-AttachVolumeNegativeTest-524744203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-08d9ef29-6e98-4472-bfe6-1310a2bfff58 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-91633556-8fcb-4a18-9c83-bdbb3c512709 req-130e54b6-6399-4c4b-9f05-7ded30c70922 tempest-AttachVolumeNegativeTest-524744203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-08d9ef29-6e98-4472-bfe6-1310a2bfff58" returned: 0 in 0.486s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-91633556-8fcb-4a18-9c83-bdbb3c512709 req-130e54b6-6399-4c4b-9f05-7ded30c70922 tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.553s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-91633556-8fcb-4a18-9c83-bdbb3c512709 req-130e54b6-6399-4c4b-9f05-7ded30c70922 tempest-AttachVolumeNegativeTest-524744203 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-08d9ef29-6e98-4472-bfe6-1310a2bfff58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb3c29dc-5314-45d6-b951-4d064abeabcb', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:20:47 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-91633556-8fcb-4a18-9c83-bdbb3c512709 req-130e54b6-6399-4c4b-9f05-7ded30c70922 tempest-AttachVolumeNegativeTest-524744203 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:20:47 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-91633556-8fcb-4a18-9c83-bdbb3c512709 req-130e54b6-6399-4c4b-9f05-7ded30c70922 tempest-AttachVolumeNegativeTest-524744203 None] attachment_update completed successfully. Sep 22 11:20:49 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Flow 'volume_create_manager' (74c061b3-389c-42e8-857d-bccf34c5c124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57fd95b3-ad48-476b-badc-80926b041484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57fd95b3-ad48-476b-badc-80926b041484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-795782436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec7786a-c1f3-4dbf-820e-240a8ead55e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9196bcdeaf674e1cb6050e6492dd57e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:20:49Z,use_quota=True,user_id='7b6f57563fe0490bb389d6216f85ee00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de194a1c-7f38-4d85-bb3f-293b6ff2540e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de194a1c-7f38-4d85-bb3f-293b6ff2540e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feacc9e3-2dde-4f19-94ca-7babee7d2ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feacc9e3-2dde-4f19-94ca-7babee7d2ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec7786a-c1f3-4dbf-820e-240a8ead55e8', 'volume_name': 'volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d8ffd6c-557d-4885-858c-8e4746e98df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d8ffd6c-557d-4885-858c-8e4746e98df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ebfe3c-41b8-4ef7-969d-4cc88c431b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:49 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Volume bec7786a-c1f3-4dbf-820e-240a8ead55e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8', 'volume_size': 1} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-795782436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec7786a-c1f3-4dbf-820e-240a8ead55e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9196bcdeaf674e1cb6050e6492dd57e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:20:49Z,use_quota=True,user_id='7b6f57563fe0490bb389d6216f85ee00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Creating volume bec7786a-c1f3-4dbf-820e-240a8ead55e8 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:20:49 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:49 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=79, name=volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8 1073741824" returned: 0 in 0.405s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8" returned: 0 in 0.101s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:50 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] <== create_volume: return (626ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:20:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.643s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ebfe3c-41b8-4ef7-969d-4cc88c431b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae4826e-7b0b-4567-9b1a-024bfec74579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:20:50 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Volume volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8 (bec7786a-c1f3-4dbf-820e-240a8ead55e8): created successfully Sep 22 11:20:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae4826e-7b0b-4567-9b1a-024bfec74579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:20:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Flow 'volume_create_manager' (74c061b3-389c-42e8-857d-bccf34c5c124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:20:50 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-9cd2ee96-57c9-40c0-8f80-a191c98f59d6 tempest-SnapshotMetadataTestJSON-2123746043 None] Created volume successfully. Sep 22 11:20:51 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:20:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] Creating offline snapshot da7f6c44-7694-49c2-950f-fda35eea8ae2 of volume bec7786a-c1f3-4dbf-820e-240a8ead55e8 {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:20:51 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[728a7b70-e1bd-4282-b154-e2e2c5fb823a]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:20:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8" returned: 0 in 0.417s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.da7f6c44-7694-49c2-950f-fda35eea8ae2 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:52 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=80, name=volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.da7f6c44-7694-49c2-950f-fda35eea8ae2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:20:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.da7f6c44-7694-49c2-950f-fda35eea8ae2 1G" returned: 0 in 0.297s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.da7f6c44-7694-49c2-950f-fda35eea8ae2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] CMD "qemu-img rebase -u -b volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.da7f6c44-7694-49c2-950f-fda35eea8ae2" returned: 0 in 0.150s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.da7f6c44-7694-49c2-950f-fda35eea8ae2 is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:20:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.da7f6c44-7694-49c2-950f-fda35eea8ae2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.da7f6c44-7694-49c2-950f-fda35eea8ae2" returned: 0 in 0.110s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8 -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:20:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.da7f6c44-7694-49c2-950f-fda35eea8ae2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.da7f6c44-7694-49c2-950f-fda35eea8ae2" returned: 0 in 0.097s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.info" returned: 0 in 0.093s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:53 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:20:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.info" returned: 0 in 0.087s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.666s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:53 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-7ed8892f-ed6b-450d-9427-5e85dc02d4aa tempest-SnapshotMetadataTestJSON-2123746043 None] Create snapshot completed successfully Sep 22 11:20:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] Acquiring lock "cinder-da7f6c44-7694-49c2-950f-fda35eea8ae2-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:20:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] Lock "cinder-da7f6c44-7694-49c2-950f-fda35eea8ae2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:20:54 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:20:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] Acquiring lock "cinder-quobyte-bec7786a-c1f3-4dbf-820e-240a8ead55e8" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:20:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] Lock "cinder-quobyte-bec7786a-c1f3-4dbf-820e-240a8ead55e8" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:20:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] Acquiring lock "cinder-quobyte-da7f6c44-7694-49c2-950f-fda35eea8ae2" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:20:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] Lock "cinder-quobyte-da7f6c44-7694-49c2-950f-fda35eea8ae2" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:20:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] Deleting offline snapshot da7f6c44-7694-49c2-950f-fda35eea8ae2 of volume bec7786a-c1f3-4dbf-820e-240a8ead55e8 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:20:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] snapshot_file for this snap is: volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.da7f6c44-7694-49c2-950f-fda35eea8ae2 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:20:54 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3b5aa2-7c8b-4661-9301-0481399d7ac5]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:20:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.da7f6c44-7694-49c2-950f-fda35eea8ae2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:55 devstack quobyte-client[83313]: System call of process 93459 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:20:55 devstack quobyte-client[83313]: System call of process 93459 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:20:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.da7f6c44-7694-49c2-950f-fda35eea8ae2" returned: 0 in 0.418s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:55 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:20:55 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0d213c-7e5f-4042-8838-9181f5261c66]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:20:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8" returned: 0 in 0.489s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.da7f6c44-7694-49c2-950f-fda35eea8ae2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:55 devstack quobyte-client[83313]: System call of process 93473 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:20:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.da7f6c44-7694-49c2-950f-fda35eea8ae2" returned: 0 in 0.325s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.da7f6c44-7694-49c2-950f-fda35eea8ae2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8.da7f6c44-7694-49c2-950f-fda35eea8ae2" returned: 0 in 0.090s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] Lock "cinder-quobyte-da7f6c44-7694-49c2-950f-fda35eea8ae2" released by "_delete_snapshot" :: held 1.743s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:20:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] Lock "cinder-quobyte-bec7786a-c1f3-4dbf-820e-240a8ead55e8" released by "delete_snapshot" :: held 1.770s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:20:56 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] Created reservations ['543ffa1e-9427-472f-a602-5689f44c523e', '1e784bad-edc2-4bc4-bc50-c94fe826fe4b', 'ff2dfe96-b726-4908-80db-87e80acc7cf4', '7640db1a-bddc-489c-a804-8e0e78040616'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:20:56 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] Delete snapshot completed successfully. Sep 22 11:20:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-25aed83f-98af-42d9-a98f-2749998cc724 tempest-SnapshotMetadataTestJSON-2123746043 None] Lock "cinder-da7f6c44-7694-49c2-950f-fda35eea8ae2-delete_snapshot" released by "delete_snapshot" :: held 2.284s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:20:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] Acquiring lock "cinder-bec7786a-c1f3-4dbf-820e-240a8ead55e8-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:20:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] Lock "cinder-bec7786a-c1f3-4dbf-820e-240a8ead55e8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:20:57 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:20:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] Acquiring lock "cinder-quobyte-bec7786a-c1f3-4dbf-820e-240a8ead55e8" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:20:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] Lock "cinder-quobyte-bec7786a-c1f3-4dbf-820e-240a8ead55e8" acquired by "delete_volume" :: waited 0.013s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:20:58 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce365e2-db52-4760-844e-7cf52545484c]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:20:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8" returned: 0 in 0.392s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bec7786a-c1f3-4dbf-820e-240a8ead55e8" returned: 0 in 0.115s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] Lock "cinder-quobyte-bec7786a-c1f3-4dbf-820e-240a8ead55e8" released by "delete_volume" :: held 0.669s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:20:58 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] Created reservations ['797178f1-4d7f-4b77-9333-b4c386caa08a', '73c82f40-5e7b-45cc-90ef-2cc3fd2bff43', 'dbddd10d-062f-428e-b2f3-830939ff59c3', '1dcf276d-1459-47f0-901e-8f49e9d416c1'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:20:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:20:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:20:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:20:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:20:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:20:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:20:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.087s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:20:59 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:20:59 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] Deleted volume successfully. Sep 22 11:20:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2c640848-9b55-4154-827d-b2b4f0185e21 tempest-SnapshotMetadataTestJSON-2123746043 None] Lock "cinder-bec7786a-c1f3-4dbf-820e-240a8ead55e8-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:21:06 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Flow 'volume_create_manager' (31c4328b-9502-4cab-bba0-3bfd38cc9e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc51ec4-e788-4a3c-8333-9831861aa49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc51ec4-e788-4a3c-8333-9831861aa49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-237991875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b478c50-4bf5-44d5-b96d-aa123e9c0c18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68d2c86da9c4d05b623f0e00970ef90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:21:06Z,use_quota=True,user_id='f9ec750452724b34b8f78807122ff8ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5011e6e7-d9d3-43af-afe0-a1105d6c401a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5011e6e7-d9d3-43af-afe0-a1105d6c401a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b020b38e-3ef3-4cc2-8511-ecea9c850d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b020b38e-3ef3-4cc2-8511-ecea9c850d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b478c50-4bf5-44d5-b96d-aa123e9c0c18', 'volume_name': 'volume-6b478c50-4bf5-44d5-b96d-aa123e9c0c18', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d8e6e2-9cd8-43a0-9d19-101aa82043ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d8e6e2-9cd8-43a0-9d19-101aa82043ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27bdb243-f9cf-410f-bb9f-4fb50c5ea541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:21:06 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Volume 6b478c50-4bf5-44d5-b96d-aa123e9c0c18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b478c50-4bf5-44d5-b96d-aa123e9c0c18', 'volume_size': 1} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-237991875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b478c50-4bf5-44d5-b96d-aa123e9c0c18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68d2c86da9c4d05b623f0e00970ef90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:21:06Z,use_quota=True,user_id='f9ec750452724b34b8f78807122ff8ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Creating volume 6b478c50-4bf5-44d5-b96d-aa123e9c0c18 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:21:06 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6b478c50-4bf5-44d5-b96d-aa123e9c0c18 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:21:06 devstack quobyte-client[83313]: System call of process 93501 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:21:06 devstack quobyte-client[83313]: System call of process 93501 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:21:06 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=82, name=volume-6b478c50-4bf5-44d5-b96d-aa123e9c0c18, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6b478c50-4bf5-44d5-b96d-aa123e9c0c18 1073741824" returned: 0 in 0.353s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6b478c50-4bf5-44d5-b96d-aa123e9c0c18 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6b478c50-4bf5-44d5-b96d-aa123e9c0c18" returned: 0 in 0.141s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] <== create_volume: return (560ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.571s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27bdb243-f9cf-410f-bb9f-4fb50c5ea541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b478c50-4bf5-44d5-b96d-aa123e9c0c18', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:21:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9d92cd-1932-450f-ac5c-629769918e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:21:07 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Volume volume-6b478c50-4bf5-44d5-b96d-aa123e9c0c18 (6b478c50-4bf5-44d5-b96d-aa123e9c0c18): created successfully Sep 22 11:21:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9d92cd-1932-450f-ac5c-629769918e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:21:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Flow 'volume_create_manager' (31c4328b-9502-4cab-bba0-3bfd38cc9e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:21:07 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-25f7ade8-f68c-4fac-ad92-b8ad8b96cba2 tempest-VolumesMetadataTest-173202807 None] Created volume successfully. Sep 22 11:21:08 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] Acquiring lock "cinder-6b478c50-4bf5-44d5-b96d-aa123e9c0c18-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:21:09 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] Lock "cinder-6b478c50-4bf5-44d5-b96d-aa123e9c0c18-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:21:09 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:21:09 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] Acquiring lock "cinder-quobyte-6b478c50-4bf5-44d5-b96d-aa123e9c0c18" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:21:09 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] Lock "cinder-quobyte-6b478c50-4bf5-44d5-b96d-aa123e9c0c18" acquired by "delete_volume" :: waited 0.011s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:21:09 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53c3c44-fe0e-4183-bb8d-694fe00e444e]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:21:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6b478c50-4bf5-44d5-b96d-aa123e9c0c18 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:21:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6b478c50-4bf5-44d5-b96d-aa123e9c0c18" returned: 0 in 0.410s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:21:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6b478c50-4bf5-44d5-b96d-aa123e9c0c18 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:21:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6b478c50-4bf5-44d5-b96d-aa123e9c0c18" returned: 0 in 0.115s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:21:09 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] Lock "cinder-quobyte-6b478c50-4bf5-44d5-b96d-aa123e9c0c18" released by "delete_volume" :: held 0.687s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:21:10 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] Created reservations ['eab3d48b-bb23-49c8-97eb-92721306d1a6', '0f719238-60bc-4dca-a61d-cdf2ac68a515', '9e0e6e74-2e32-431f-9a22-bf66fb003e57', '1017ad10-8ed6-49c3-a7d1-6ebecd9f3548'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:21:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:21:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:21:10 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:21:10 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:21:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:21:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:21:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.118s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:21:10 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:21:10 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] Deleted volume successfully. Sep 22 11:21:10 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-17bebf4b-54e7-4d34-b819-c3e4272154f1 tempest-VolumesMetadataTest-173202807 None] Lock "cinder-6b478c50-4bf5-44d5-b96d-aa123e9c0c18-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:21:17 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-1630160f-a74a-4869-b2f2-f41f49ff762f req-bcc77dca-659c-4aca-9c02-8699b9c75583 tempest-AttachVolumeNegativeTest-524744203 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:21:17 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=51,cinder:DELETE=8,cinder:UPDATE=62,cinder:INSERT=11 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:21:17 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=78,cinder:SELECT=48,cinder:DELETE=6,cinder:INSERT=17 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:21:17 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-1630160f-a74a-4869-b2f2-f41f49ff762f req-bcc77dca-659c-4aca-9c02-8699b9c75583 tempest-AttachVolumeNegativeTest-524744203 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:21:17 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-1630160f-a74a-4869-b2f2-f41f49ff762f req-bcc77dca-659c-4aca-9c02-8699b9c75583 tempest-AttachVolumeNegativeTest-524744203 None] Terminate volume connection completed successfully. Sep 22 11:21:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-1630160f-a74a-4869-b2f2-f41f49ff762f req-bcc77dca-659c-4aca-9c02-8699b9c75583 tempest-AttachVolumeNegativeTest-524744203 None] Deleting attachment eb3c29dc-5314-45d6-b951-4d064abeabcb. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:21:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:21:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:21:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:21:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:21:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:21:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:21:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:21:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.129s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:21:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:21:29 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:21:29 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Flow 'volume_create_manager' (84542c1f-cc15-4544-b9d7-1367ed0ee99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0a6bcb-d39e-4cbb-b43e-48aeb4289fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0a6bcb-d39e-4cbb-b43e-48aeb4289fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-444161830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c141b0-22aa-419e-b461-d15842926f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de123be3945942b59b3d6ec92397e935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:21:30Z,use_quota=True,user_id='40987c30f2e248f0975b63d558f1bdde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a2f393-1cbc-42cb-b3b6-b701403e67c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a2f393-1cbc-42cb-b3b6-b701403e67c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c69e4370-3dc0-4046-bb16-486546406d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c69e4370-3dc0-4046-bb16-486546406d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3c141b0-22aa-419e-b461-d15842926f70', 'volume_name': 'volume-b3c141b0-22aa-419e-b461-d15842926f70', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0fc5e2-9b32-44e9-b0a5-6f9cab8418ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0fc5e2-9b32-44e9-b0a5-6f9cab8418ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70b8915-41ef-43dd-b400-c7589c197f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:21:30 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Volume b3c141b0-22aa-419e-b461-d15842926f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3c141b0-22aa-419e-b461-d15842926f70', 'volume_size': 1} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-444161830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c141b0-22aa-419e-b461-d15842926f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de123be3945942b59b3d6ec92397e935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:21:30Z,use_quota=True,user_id='40987c30f2e248f0975b63d558f1bdde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Creating volume b3c141b0-22aa-419e-b461-d15842926f70 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:21:30 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:21:30 devstack quobyte-client[83313]: System call of process 93589 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:21:30 devstack quobyte-client[83313]: System call of process 93589 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:21:30 devstack quobyte-client[83313]: System call of process 93589 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:21:30 devstack quobyte-client[83313]: System call of process 93589 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:21:30 devstack quobyte-client[83313]: System call of process 93589 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:21:30 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=83, name=volume-b3c141b0-22aa-419e-b461-d15842926f70, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70 1073741824" returned: 0 in 0.436s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70" returned: 0 in 0.187s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] <== create_volume: return (717ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:21:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:21:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70b8915-41ef-43dd-b400-c7589c197f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3c141b0-22aa-419e-b461-d15842926f70', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:21:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d1de66-1a84-45fe-b557-505c23a5443e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:21:31 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Volume volume-b3c141b0-22aa-419e-b461-d15842926f70 (b3c141b0-22aa-419e-b461-d15842926f70): created successfully Sep 22 11:21:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d1de66-1a84-45fe-b557-505c23a5443e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:21:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Flow 'volume_create_manager' (84542c1f-cc15-4544-b9d7-1367ed0ee99d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:21:31 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-0f6e2577-4e25-449d-9af8-bd6c0daff34e tempest-VolumesActionsTest-596222327 None] Created volume successfully. Sep 22 11:21:41 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=4 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:21:41 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=2,cinder:DELETE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:22:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4fb06017-8595-4ab6-b4df-d6213ef25a06 tempest-VolumesActionsTest-596222327 None] Acquiring lock "cinder-b3c141b0-22aa-419e-b461-d15842926f70" by "attach_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:22:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4fb06017-8595-4ab6-b4df-d6213ef25a06 tempest-VolumesActionsTest-596222327 None] Lock "cinder-b3c141b0-22aa-419e-b461-d15842926f70" acquired by "attach_volume" :: waited 0.064s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:22:05 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-4fb06017-8595-4ab6-b4df-d6213ef25a06 tempest-VolumesActionsTest-596222327 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:22:05 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-4fb06017-8595-4ab6-b4df-d6213ef25a06 tempest-VolumesActionsTest-596222327 None] Attaching volume b3c141b0-22aa-419e-b461-d15842926f70 to instance 14973393-516a-4d17-8d2d-9d6fcea8ea55 at mountpoint /dev/vdb on host None. Sep 22 11:22:05 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-4fb06017-8595-4ab6-b4df-d6213ef25a06 tempest-VolumesActionsTest-596222327 None] Attach volume completed successfully. Sep 22 11:22:05 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4fb06017-8595-4ab6-b4df-d6213ef25a06 tempest-VolumesActionsTest-596222327 None] Lock "cinder-b3c141b0-22aa-419e-b461-d15842926f70" released by "attach_volume" :: held 0.650s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:22:06 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-401754b6-d9fb-4ca5-b426-f4b70ca927ee tempest-VolumesActionsTest-596222327 None] Acquiring lock "cinder-b3c141b0-22aa-419e-b461-d15842926f70-detach_volume" by "detach_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:22:06 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-401754b6-d9fb-4ca5-b426-f4b70ca927ee tempest-VolumesActionsTest-596222327 None] Lock "cinder-b3c141b0-22aa-419e-b461-d15842926f70-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:22:06 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-401754b6-d9fb-4ca5-b426-f4b70ca927ee tempest-VolumesActionsTest-596222327 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:22:06 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-401754b6-d9fb-4ca5-b426-f4b70ca927ee tempest-VolumesActionsTest-596222327 None] Detaching volume b3c141b0-22aa-419e-b461-d15842926f70 from instance 14973393-516a-4d17-8d2d-9d6fcea8ea55. Sep 22 11:22:06 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-401754b6-d9fb-4ca5-b426-f4b70ca927ee tempest-VolumesActionsTest-596222327 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:22:06 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-401754b6-d9fb-4ca5-b426-f4b70ca927ee tempest-VolumesActionsTest-596222327 None] Detach volume completed successfully. Sep 22 11:22:06 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-401754b6-d9fb-4ca5-b426-f4b70ca927ee tempest-VolumesActionsTest-596222327 None] Lock "cinder-b3c141b0-22aa-419e-b461-d15842926f70-detach_volume" released by "detach_volume" :: held 0.248s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:22:16 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:22:16 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=5,cinder:SELECT=9,cinder:INSERT=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:22:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:22:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:22:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:22:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:22:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:22:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:22:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:22:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.198s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:22:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:22:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-65b0661d-f616-420b-805a-70779854173a tempest-VolumesActionsTest-596222327 None] Acquiring lock "cinder-b3c141b0-22aa-419e-b461-d15842926f70" by "attach_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:22:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-65b0661d-f616-420b-805a-70779854173a tempest-VolumesActionsTest-596222327 None] Lock "cinder-b3c141b0-22aa-419e-b461-d15842926f70" acquired by "attach_volume" :: waited 0.034s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:22:44 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-65b0661d-f616-420b-805a-70779854173a tempest-VolumesActionsTest-596222327 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:22:44 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-65b0661d-f616-420b-805a-70779854173a tempest-VolumesActionsTest-596222327 None] Attaching volume b3c141b0-22aa-419e-b461-d15842926f70 to instance cd1baa4e-cf0a-42b9-882e-ee81c06c4e25 at mountpoint /dev/vdb on host None. Sep 22 11:22:44 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-65b0661d-f616-420b-805a-70779854173a tempest-VolumesActionsTest-596222327 None] Attach volume completed successfully. Sep 22 11:22:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-65b0661d-f616-420b-805a-70779854173a tempest-VolumesActionsTest-596222327 None] Lock "cinder-b3c141b0-22aa-419e-b461-d15842926f70" released by "attach_volume" :: held 0.350s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:22:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8a701df5-4c1c-47a6-912a-0a8793e92e8c tempest-VolumesActionsTest-596222327 None] Acquiring lock "cinder-b3c141b0-22aa-419e-b461-d15842926f70-detach_volume" by "detach_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:22:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8a701df5-4c1c-47a6-912a-0a8793e92e8c tempest-VolumesActionsTest-596222327 None] Lock "cinder-b3c141b0-22aa-419e-b461-d15842926f70-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:22:45 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-8a701df5-4c1c-47a6-912a-0a8793e92e8c tempest-VolumesActionsTest-596222327 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:22:45 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-8a701df5-4c1c-47a6-912a-0a8793e92e8c tempest-VolumesActionsTest-596222327 None] Detaching volume b3c141b0-22aa-419e-b461-d15842926f70 from instance cd1baa4e-cf0a-42b9-882e-ee81c06c4e25. Sep 22 11:22:45 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-8a701df5-4c1c-47a6-912a-0a8793e92e8c tempest-VolumesActionsTest-596222327 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:22:45 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-8a701df5-4c1c-47a6-912a-0a8793e92e8c tempest-VolumesActionsTest-596222327 None] Detach volume completed successfully. Sep 22 11:22:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8a701df5-4c1c-47a6-912a-0a8793e92e8c tempest-VolumesActionsTest-596222327 None] Lock "cinder-b3c141b0-22aa-419e-b461-d15842926f70-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:22:55 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:22:55 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:INSERT=2,cinder:SELECT=5,cinder:UPDATE=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:22:56 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-7c92b20c-d469-48b6-9b23-c48c7685e7c1 tempest-VolumesActionsTest-596222327 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:22:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c92b20c-d469-48b6-9b23-c48c7685e7c1 tempest-VolumesActionsTest-596222327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:22:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c92b20c-d469-48b6-9b23-c48c7685e7c1 tempest-VolumesActionsTest-596222327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:22:56 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ece1ff5-8228-4b53-b426-0027a7caee84]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:22:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c92b20c-d469-48b6-9b23-c48c7685e7c1 tempest-VolumesActionsTest-596222327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:22:57 devstack quobyte-client[83313]: System call of process 94158 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:22:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c92b20c-d469-48b6-9b23-c48c7685e7c1 tempest-VolumesActionsTest-596222327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70" returned: 0 in 0.494s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:22:57 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e2ad6c-b5e3-4868-9eb3-0881cdf33430]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:22:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c92b20c-d469-48b6-9b23-c48c7685e7c1 tempest-VolumesActionsTest-596222327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:22:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c92b20c-d469-48b6-9b23-c48c7685e7c1 tempest-VolumesActionsTest-596222327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70" returned: 0 in 0.467s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:22:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c92b20c-d469-48b6-9b23-c48c7685e7c1 tempest-VolumesActionsTest-596222327 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70 /opt/stack/data/cinder/conversion/b3c141b0-22aa-419e-b461-d15842926f70.temp_image.77ce3172-d387-47d1-a249-3ab2714ef3ffyolwl86e.img {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:22:57 devstack quobyte-client[83313]: System call of process 94164 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:22:57 devstack quobyte-client[83313]: System call of process 94164 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:22:57 devstack quobyte-client[83313]: System call of process 94164 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:22:57 devstack quobyte-client[83313]: System call of process 94164 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:23:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c92b20c-d469-48b6-9b23-c48c7685e7c1 tempest-VolumesActionsTest-596222327 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70 /opt/stack/data/cinder/conversion/b3c141b0-22aa-419e-b461-d15842926f70.temp_image.77ce3172-d387-47d1-a249-3ab2714ef3ffyolwl86e.img" returned: 0 in 6.973s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:23:04 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[71eab947-75b7-4da4-aa6c-70d7adf5ec02]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:23:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c92b20c-d469-48b6-9b23-c48c7685e7c1 tempest-VolumesActionsTest-596222327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:23:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c92b20c-d469-48b6-9b23-c48c7685e7c1 tempest-VolumesActionsTest-596222327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70" returned: 0 in 0.626s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:23:05 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-7c92b20c-d469-48b6-9b23-c48c7685e7c1 tempest-VolumesActionsTest-596222327 None] Image conversion details: src /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70, size 1024.00 MB, duration 7.01 sec, destination /opt/stack/data/cinder/conversion/b3c141b0-22aa-419e-b461-d15842926f70.temp_image.77ce3172-d387-47d1-a249-3ab2714ef3ffyolwl86e.img {{(pid=83310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 22 11:23:05 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-7c92b20c-d469-48b6-9b23-c48c7685e7c1 tempest-VolumesActionsTest-596222327 None] Converted 1024.00 MB image at 146.15 MB/s Sep 22 11:23:05 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-7c92b20c-d469-48b6-9b23-c48c7685e7c1 tempest-VolumesActionsTest-596222327 None] 77ce3172-d387-47d1-a249-3ab2714ef3ff was raw, no need to convert to raw {{(pid=83310) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}} Sep 22 11:23:09 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:23:09 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:23:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Flow 'volume_create_manager' (f8a0dd58-22d4-4af5-9104-13382148992e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:23:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f325e74-24ec-433a-90ce-88e3847adf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:23:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f325e74-24ec-433a-90ce-88e3847adf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1952573883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0418d6a-f624-4ab4-85c7-15b403cc858f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839c8213b56a45ccb63853de8a29eed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:23:09Z,use_quota=True,user_id='d5d28ef8ea4a48b6bca56ef8ece2b2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:23:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7519af6d-e412-4545-9cca-d09ea5c413db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:23:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7519af6d-e412-4545-9cca-d09ea5c413db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:23:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903c4038-4643-4020-bfc8-64deb7c41b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:23:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903c4038-4643-4020-bfc8-64deb7c41b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0418d6a-f624-4ab4-85c7-15b403cc858f', 'volume_name': 'volume-a0418d6a-f624-4ab4-85c7-15b403cc858f', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:23:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae446d6c-b0eb-47b4-b468-d9ee0851c322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:23:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae446d6c-b0eb-47b4-b468-d9ee0851c322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:23:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d263c4a2-d7f9-45a5-ae9d-c27e93093e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:23:09 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Volume a0418d6a-f624-4ab4-85c7-15b403cc858f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0418d6a-f624-4ab4-85c7-15b403cc858f', 'volume_size': 1} Sep 22 11:23:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:23:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:23:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:23:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:23:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:23:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:23:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:23:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:23:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.180s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:23:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:23:19 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:23:19 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:23:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c92b20c-d469-48b6-9b23-c48c7685e7c1 tempest-VolumesActionsTest-596222327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 47.355s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:23:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7c92b20c-d469-48b6-9b23-c48c7685e7c1 tempest-VolumesActionsTest-596222327 None] Uploaded volume to glance image-id: 77ce3172-d387-47d1-a249-3ab2714ef3ff. {{(pid=83310) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 22 11:23:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 34.640s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:23:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1952573883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0418d6a-f624-4ab4-85c7-15b403cc858f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839c8213b56a45ccb63853de8a29eed8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:23:09Z,use_quota=True,user_id='d5d28ef8ea4a48b6bca56ef8ece2b2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:23:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Creating volume a0418d6a-f624-4ab4-85c7-15b403cc858f {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:23:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:23:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:23:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:23:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:23:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:23:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:23:44 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:23:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a0418d6a-f624-4ab4-85c7-15b403cc858f 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:23:44 devstack quobyte-client[83313]: System call of process 94255 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:23:44 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=84, name=volume-a0418d6a-f624-4ab4-85c7-15b403cc858f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:23:44 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-7c92b20c-d469-48b6-9b23-c48c7685e7c1 tempest-VolumesActionsTest-596222327 None] Copy volume to image completed successfully. Sep 22 11:23:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a0418d6a-f624-4ab4-85c7-15b403cc858f 1073741824" returned: 0 in 0.460s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:23:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a0418d6a-f624-4ab4-85c7-15b403cc858f {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:23:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a0418d6a-f624-4ab4-85c7-15b403cc858f" returned: 0 in 0.095s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:23:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] <== create_volume: return (610ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:23:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.632s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:23:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d263c4a2-d7f9-45a5-ae9d-c27e93093e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0418d6a-f624-4ab4-85c7-15b403cc858f', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:23:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a20a01-923d-4e99-96dd-4eb31cba7772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:23:45 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Volume volume-a0418d6a-f624-4ab4-85c7-15b403cc858f (a0418d6a-f624-4ab4-85c7-15b403cc858f): created successfully Sep 22 11:23:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a20a01-923d-4e99-96dd-4eb31cba7772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:23:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Flow 'volume_create_manager' (f8a0dd58-22d4-4af5-9104-13382148992e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:23:45 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-29808478-0943-4fb9-b4e2-d867db0a58d9 tempest-AttachVolumeNegativeTest-524744203 None] Created volume successfully. Sep 22 11:23:46 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:23:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:23:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:23:46 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4130070a-ae78-440b-a09a-b1a8fcc66736]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:23:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:23:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70" returned: 0 in 0.518s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:23:47 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e928d57c-73d2-47e2-9083-1c3133a3966e]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:23:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:23:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70" returned: 0 in 0.451s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:23:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70 /opt/stack/data/cinder/conversion/b3c141b0-22aa-419e-b461-d15842926f70.temp_image.bf3526f4-2f0b-4d40-8d2b-f95f9d5cf989yamirpg7.img {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:23:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-5323492a-0bdb-404c-b8ba-41df4ca578fa req-0c7bf172-5a23-49dc-b4cd-2d0d83a7b0ad tempest-AttachVolumeNegativeTest-524744203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:23:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70 /opt/stack/data/cinder/conversion/b3c141b0-22aa-419e-b461-d15842926f70.temp_image.bf3526f4-2f0b-4d40-8d2b-f95f9d5cf989yamirpg7.img" returned: 0 in 5.686s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:23:53 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a1f60a-d8cd-415f-94c5-64bb353b8613]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:23:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:23:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70" returned: 0 in 0.607s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:23:54 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] Image conversion details: src /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/conversion/b3c141b0-22aa-419e-b461-d15842926f70.temp_image.bf3526f4-2f0b-4d40-8d2b-f95f9d5cf989yamirpg7.img {{(pid=83310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 22 11:23:54 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] Converted 1024.00 MB image at 179.98 MB/s Sep 22 11:23:54 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] bf3526f4-2f0b-4d40-8d2b-f95f9d5cf989 was raw, converting to qcow2 {{(pid=83310) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}} Sep 22 11:23:54 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[306403e9-e8d8-4905-8b58-1f8c5b5214b9]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:23:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b3c141b0-22aa-419e-b461-d15842926f70.temp_image.bf3526f4-2f0b-4d40-8d2b-f95f9d5cf989yamirpg7.img {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:23:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b3c141b0-22aa-419e-b461-d15842926f70.temp_image.bf3526f4-2f0b-4d40-8d2b-f95f9d5cf989yamirpg7.img" returned: 0 in 0.354s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:23:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3c141b0-22aa-419e-b461-d15842926f70.temp_image.bf3526f4-2f0b-4d40-8d2b-f95f9d5cf989yamirpg7.img {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:23:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3c141b0-22aa-419e-b461-d15842926f70.temp_image.bf3526f4-2f0b-4d40-8d2b-f95f9d5cf989yamirpg7.img" returned: 1 in 0.363s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:23:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3c141b0-22aa-419e-b461-d15842926f70.temp_image.bf3526f4-2f0b-4d40-8d2b-f95f9d5cf989yamirpg7.img' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:23:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b3c141b0-22aa-419e-b461-d15842926f70.temp_image.bf3526f4-2f0b-4d40-8d2b-f95f9d5cf989yamirpg7.img /opt/stack/data/cinder/conversion/vol_upload_l1za518o {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:23:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b3c141b0-22aa-419e-b461-d15842926f70.temp_image.bf3526f4-2f0b-4d40-8d2b-f95f9d5cf989yamirpg7.img /opt/stack/data/cinder/conversion/vol_upload_l1za518o" returned: 0 in 0.138s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:23:55 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] Image conversion details: src /opt/stack/data/cinder/conversion/b3c141b0-22aa-419e-b461-d15842926f70.temp_image.bf3526f4-2f0b-4d40-8d2b-f95f9d5cf989yamirpg7.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_l1za518o {{(pid=83310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 22 11:23:55 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 22 11:23:55 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91e4cfb-49fb-48f7-9b72-1e7d723cbec3]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:23:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_l1za518o {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:23:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_l1za518o" returned: 0 in 0.349s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:23:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.213s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:23:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] Uploaded volume to glance image-id: bf3526f4-2f0b-4d40-8d2b-f95f9d5cf989. {{(pid=83310) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 22 11:23:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-5323492a-0bdb-404c-b8ba-41df4ca578fa req-0c7bf172-5a23-49dc-b4cd-2d0d83a7b0ad tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.218s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:23:56 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac24e48-76cd-4a9f-995b-24bfe1344423]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:23:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-5323492a-0bdb-404c-b8ba-41df4ca578fa req-0c7bf172-5a23-49dc-b4cd-2d0d83a7b0ad tempest-AttachVolumeNegativeTest-524744203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a0418d6a-f624-4ab4-85c7-15b403cc858f {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:23:57 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-118ed8da-1889-487b-8582-a97515f52504 tempest-VolumesActionsTest-596222327 None] Copy volume to image completed successfully. Sep 22 11:23:57 devstack quobyte-client[83313]: System call of process 94306 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:23:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-5323492a-0bdb-404c-b8ba-41df4ca578fa req-0c7bf172-5a23-49dc-b4cd-2d0d83a7b0ad tempest-AttachVolumeNegativeTest-524744203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a0418d6a-f624-4ab4-85c7-15b403cc858f" returned: 0 in 0.494s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:23:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-5323492a-0bdb-404c-b8ba-41df4ca578fa req-0c7bf172-5a23-49dc-b4cd-2d0d83a7b0ad tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.605s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:23:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-5323492a-0bdb-404c-b8ba-41df4ca578fa req-0c7bf172-5a23-49dc-b4cd-2d0d83a7b0ad tempest-AttachVolumeNegativeTest-524744203 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-a0418d6a-f624-4ab4-85c7-15b403cc858f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3db64604-5bf1-48dc-9d12-b36ff8ff6865', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:23:57 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-5323492a-0bdb-404c-b8ba-41df4ca578fa req-0c7bf172-5a23-49dc-b4cd-2d0d83a7b0ad tempest-AttachVolumeNegativeTest-524744203 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:23:57 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-5323492a-0bdb-404c-b8ba-41df4ca578fa req-0c7bf172-5a23-49dc-b4cd-2d0d83a7b0ad tempest-AttachVolumeNegativeTest-524744203 None] attachment_update completed successfully. Sep 22 11:23:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] Acquiring lock "cinder-b3c141b0-22aa-419e-b461-d15842926f70-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:23:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] Lock "cinder-b3c141b0-22aa-419e-b461-d15842926f70-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:23:58 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:23:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] Acquiring lock "cinder-quobyte-b3c141b0-22aa-419e-b461-d15842926f70" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:23:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] Lock "cinder-quobyte-b3c141b0-22aa-419e-b461-d15842926f70" acquired by "delete_volume" :: waited 0.021s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:23:58 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b9dfc3-d004-4a27-bcb7-ab66c03fd178]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:23:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:23:59 devstack quobyte-client[83313]: System call of process 94331 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:23:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70" returned: 0 in 0.556s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:23:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:23:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b3c141b0-22aa-419e-b461-d15842926f70" returned: 0 in 0.093s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:23:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] Lock "cinder-quobyte-b3c141b0-22aa-419e-b461-d15842926f70" released by "delete_volume" :: held 0.813s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:23:59 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] Created reservations ['a92c6f04-a170-450e-8770-b21d01d7e6d8', '61a5f50b-c344-4c2e-901f-4ef95177bd4c', 'a8552a3b-d6e2-4389-9e49-deeb874daa8c', '63aafd95-5a54-4eb6-8318-875ed5d75e74'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:23:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:23:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:23:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:23:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:23:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:23:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:23:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.132s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:23:59 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:24:00 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] Deleted volume successfully. Sep 22 11:24:00 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5e79e6d3-ba0c-463c-a36b-f7aa0207f449 tempest-VolumesActionsTest-596222327 None] Lock "cinder-b3c141b0-22aa-419e-b461-d15842926f70-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:24:09 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=10,cinder:UPDATE=15,cinder:INSERT=4 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:24:10 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=10,cinder:DELETE=2,cinder:SELECT=17 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:24:11 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:24:11 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:24:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Flow 'volume_create_manager' (dc5b2613-c445-42fc-809b-7b1defed30f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:24:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c68880d-6ff3-4e3e-9483-78da21d58c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:24:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c68880d-6ff3-4e3e-9483-78da21d58c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1046300799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf08f21c-8510-4e58-9d48-f991b9576025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d449179744428783720ec249f024f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:24:11Z,use_quota=True,user_id='5bef163e54f643ff8beeecc20130d09e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:24:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a615bd7d-9be1-4e9e-b9d7-254e561574e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:24:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a615bd7d-9be1-4e9e-b9d7-254e561574e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:24:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0400e4b-81c4-4c38-aa6a-666e5786d24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:24:11 devstack cinder-volume[83310]: DEBUG cinder.image.glance [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Creating Keystone auth plugin from conf {{(pid=83310) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 22 11:24:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0400e4b-81c4-4c38-aa6a-666e5786d24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bf08f21c-8510-4e58-9d48-f991b9576025', 'volume_name': 'volume-bf08f21c-8510-4e58-9d48-f991b9576025', 'volume_size': 1, 'image_id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a739f36f4ea4c5eb46d43587eb0544d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'created_at': datetime.datetime(2025, 9, 22, 8, 49, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 8, 49, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a1d9109-49e8-406b-a105-f8fc540ab994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:24:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1755f1-05f3-4457-aef6-01bc45ab92bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:24:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1755f1-05f3-4457-aef6-01bc45ab92bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:24:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0581a784-4cb8-4144-913b-d83f8a85b062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:24:11 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Volume bf08f21c-8510-4e58-9d48-f991b9576025: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bf08f21c-8510-4e58-9d48-f991b9576025', 'volume_size': 1, 'image_id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a739f36f4ea4c5eb46d43587eb0544d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'created_at': datetime.datetime(2025, 9, 22, 8, 49, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 8, 49, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a1d9109-49e8-406b-a105-f8fc540ab994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 22 11:24:11 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Cloning bf08f21c-8510-4e58-9d48-f991b9576025 from image 1a1d9109-49e8-406b-a105-f8fc540ab994 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}]). {{(pid=83310) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 22 11:24:12 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_q770rguadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 22 11:24:12 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Image download 20.69 MB at 20.69 MB/s Sep 22 11:24:12 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d01b7d-f9c9-4515-b23c-f5d57aa6dcdc]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:24:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_q770rguadevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:12 devstack sudo[94709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_q770rguadevstack@QuobyteHD Sep 22 11:24:12 devstack sudo[94709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 11:24:14 devstack sudo[94709]: pam_unix(sudo:session): session closed for user root Sep 22 11:24:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_q770rguadevstack@QuobyteHD" returned: 0 in 2.085s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:14 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Temporary image 1a1d9109-49e8-406b-a105-f8fc540ab994 is fetched for user 5bef163e54f643ff8beeecc20130d09e. {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 22 11:24:14 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b45d212-0803-4d44-8129-76309d4e9250]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:24:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_q770rguadevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:15 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_q770rguadevstack@QuobyteHD Sep 22 11:24:15 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 11:24:16 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Sep 22 11:24:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_q770rguadevstack@QuobyteHD" returned: 0 in 1.984s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:24:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:24:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1046300799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf08f21c-8510-4e58-9d48-f991b9576025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d449179744428783720ec249f024f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:24:11Z,use_quota=True,user_id='5bef163e54f643ff8beeecc20130d09e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:24:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Creating volume bf08f21c-8510-4e58-9d48-f991b9576025 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:24:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:24:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:24:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:24:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:24:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:24:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:24:16 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:24:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:16 devstack quobyte-client[83313]: System call of process 94720 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:16 devstack quobyte-client[83313]: System call of process 94720 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:16 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=85, name=volume-bf08f21c-8510-4e58-9d48-f991b9576025, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:24:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025 1073741824" returned: 0 in 0.364s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025" returned: 0 in 0.096s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] <== create_volume: return (559ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:24:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.594s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:24:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:24:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:24:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:24:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:24:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:24:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:24:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:17 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Attempting download of 1a1d9109-49e8-406b-a105-f8fc540ab994 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}])) to volume bf08f21c-8510-4e58-9d48-f991b9576025. {{(pid=83310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 22 11:24:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.264s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:24:17 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c07e0c-04a0-4952-a94b-c8e5ac383aaa]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:24:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_suf7hsec {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_suf7hsec" returned: 0 in 0.388s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_suf7hsec {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_suf7hsec" returned: 1 in 0.347s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_suf7hsec' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:24:18 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe18609-151b-4640-8216-892ea6253183]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:24:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_q770rguadevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_q770rguadevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:19 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] 1a1d9109-49e8-406b-a105-f8fc540ab994 was qcow2, converting to raw {{(pid=83310) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 22 11:24:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_q770rguadevstack@QuobyteHD /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:19 devstack quobyte-client[83313]: System call of process 94756 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:19 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=85, name=volume-bf08f21c-8510-4e58-9d48-f991b9576025, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:24:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_q770rguadevstack@QuobyteHD /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025" returned: 0 in 0.983s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:20 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_q770rguadevstack@QuobyteHD, size 112.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025 {{(pid=83310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 22 11:24:20 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Converted 112.00 MB image at 111.08 MB/s Sep 22 11:24:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:20 devstack quobyte-client[83313]: System call of process 94763 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025 1G" returned: 0 in 0.145s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:20 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3d4102-69cc-4116-a18f-bf5d907947e9]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:24:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025" returned: 0 in 0.364s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:21 devstack quobyte-client[83313]: System call of process 94768 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025" returned: 1 in 0.428s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:24:21 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Downloaded image 1a1d9109-49e8-406b-a105-f8fc540ab994 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}])) to volume bf08f21c-8510-4e58-9d48-f991b9576025 successfully. {{(pid=83310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 22 11:24:21 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Temporary image 1a1d9109-49e8-406b-a105-f8fc540ab994 for user 5bef163e54f643ff8beeecc20130d09e is deleted. {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 22 11:24:21 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Marking volume bf08f21c-8510-4e58-9d48-f991b9576025 as bootable. {{(pid=83310) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 22 11:24:21 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Copying metadata from image 1a1d9109-49e8-406b-a105-f8fc540ab994 to bf08f21c-8510-4e58-9d48-f991b9576025. {{(pid=83310) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 11:24:21 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Creating volume glance metadata for volume bf08f21c-8510-4e58-9d48-f991b9576025 backed by image 1a1d9109-49e8-406b-a105-f8fc540ab994 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83310) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 11:24:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0581a784-4cb8-4144-913b-d83f8a85b062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf08f21c-8510-4e58-9d48-f991b9576025', 'volume_size': 1, 'image_id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a739f36f4ea4c5eb46d43587eb0544d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'created_at': datetime.datetime(2025, 9, 22, 8, 49, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 8, 49, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a1d9109-49e8-406b-a105-f8fc540ab994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:24:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd236ac-7466-4086-a0d5-5b786bbd5389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:24:21 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Volume volume-bf08f21c-8510-4e58-9d48-f991b9576025 (bf08f21c-8510-4e58-9d48-f991b9576025): created successfully Sep 22 11:24:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd236ac-7466-4086-a0d5-5b786bbd5389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:24:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Flow 'volume_create_manager' (dc5b2613-c445-42fc-809b-7b1defed30f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:24:21 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-16be46c1-be04-4e0c-99d3-91ba6cb8f1ca tempest-VolumesExtendTest-375823913 None] Created volume successfully. Sep 22 11:24:22 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-f690426d-e0ed-48ec-ba00-3b9757376396 tempest-VolumesExtendTest-375823913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:24:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f690426d-e0ed-48ec-ba00-3b9757376396 tempest-VolumesExtendTest-375823913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:24:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f690426d-e0ed-48ec-ba00-3b9757376396 tempest-VolumesExtendTest-375823913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:24:22 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd756312-91dc-46da-9cf4-a5f7159e3a4c]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:24:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f690426d-e0ed-48ec-ba00-3b9757376396 tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f690426d-e0ed-48ec-ba00-3b9757376396 tempest-VolumesExtendTest-375823913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025" returned: 0 in 0.418s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f690426d-e0ed-48ec-ba00-3b9757376396 tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:23 devstack quobyte-client[83313]: System call of process 94773 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f690426d-e0ed-48ec-ba00-3b9757376396 tempest-VolumesExtendTest-375823913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025" returned: 1 in 0.420s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f690426d-e0ed-48ec-ba00-3b9757376396 tempest-VolumesExtendTest-375823913 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:24:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f690426d-e0ed-48ec-ba00-3b9757376396 tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025 2G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:23 devstack quobyte-client[83313]: System call of process 94776 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f690426d-e0ed-48ec-ba00-3b9757376396 tempest-VolumesExtendTest-375823913 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025 2G" returned: 0 in 0.153s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f690426d-e0ed-48ec-ba00-3b9757376396 tempest-VolumesExtendTest-375823913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.174s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:24:23 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-f690426d-e0ed-48ec-ba00-3b9757376396 tempest-VolumesExtendTest-375823913 None] Extend volume completed successfully. Sep 22 11:24:24 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] Acquiring lock "cinder-bf08f21c-8510-4e58-9d48-f991b9576025-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:24:24 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] Lock "cinder-bf08f21c-8510-4e58-9d48-f991b9576025-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:24:24 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:24:24 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] Acquiring lock "cinder-quobyte-bf08f21c-8510-4e58-9d48-f991b9576025" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:24:24 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] Lock "cinder-quobyte-bf08f21c-8510-4e58-9d48-f991b9576025" acquired by "delete_volume" :: waited 0.011s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:24:25 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6cb3d3-bb8c-4333-916a-e9e9afb856af]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:24:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025" returned: 0 in 0.420s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025" returned: 1 in 0.492s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:24:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bf08f21c-8510-4e58-9d48-f991b9576025" returned: 0 in 0.117s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:26 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] Lock "cinder-quobyte-bf08f21c-8510-4e58-9d48-f991b9576025" released by "delete_volume" :: held 1.285s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:24:26 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] Created reservations ['d1af8039-7306-446b-8ebb-190bce1c03be', '8544dc0c-45e1-4895-b963-cc03e019eb86', '85e3e4c5-22f9-4533-85f3-c427ef08f5e6', 'f64f8ba0-cea2-4af7-b061-6967e2d3fd5c'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:24:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:24:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:24:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:24:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:24:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:24:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.103s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:26 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:24:26 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] Deleted volume successfully. Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-18eb54b8-6470-4674-a691-4f584fd4ad36 tempest-VolumesExtendTest-375823913 None] Lock "cinder-bf08f21c-8510-4e58-9d48-f991b9576025-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:24:27 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-77f4157f-b83c-4c35-9a21-190b713944ca req-80a6589d-3d27-4fc5-af2c-42e7de6405ec tempest-AttachVolumeNegativeTest-524744203 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:24:27 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-77f4157f-b83c-4c35-9a21-190b713944ca req-80a6589d-3d27-4fc5-af2c-42e7de6405ec tempest-AttachVolumeNegativeTest-524744203 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:24:27 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-77f4157f-b83c-4c35-9a21-190b713944ca req-80a6589d-3d27-4fc5-af2c-42e7de6405ec tempest-AttachVolumeNegativeTest-524744203 None] Terminate volume connection completed successfully. Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-77f4157f-b83c-4c35-9a21-190b713944ca req-80a6589d-3d27-4fc5-af2c-42e7de6405ec tempest-AttachVolumeNegativeTest-524744203 None] Deleting attachment 3db64604-5bf1-48dc-9d12-b36ff8ff6865. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:24:27 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Flow 'volume_create_manager' (a41ef069-5636-48ec-bb0f-e210861fee4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226bb5d0-5a53-4ddf-b169-3804e4393859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226bb5d0-5a53-4ddf-b169-3804e4393859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1726567584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f42724-c650-497b-9fa6-4c94608f413a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d449179744428783720ec249f024f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:24:28Z,use_quota=True,user_id='5bef163e54f643ff8beeecc20130d09e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ed7a95-ea05-4136-b852-1d286d6f837f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ed7a95-ea05-4136-b852-1d286d6f837f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f144da-557d-4989-add7-29af74307302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f144da-557d-4989-add7-29af74307302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f42724-c650-497b-9fa6-4c94608f413a', 'volume_name': 'volume-c6f42724-c650-497b-9fa6-4c94608f413a', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be76cad-66fb-4eab-ab13-22716e5bd55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be76cad-66fb-4eab-ab13-22716e5bd55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3415af7-b1fa-4db9-b290-8df759a8fd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:24:27 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Volume c6f42724-c650-497b-9fa6-4c94608f413a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f42724-c650-497b-9fa6-4c94608f413a', 'volume_size': 1} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1726567584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f42724-c650-497b-9fa6-4c94608f413a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d449179744428783720ec249f024f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:24:28Z,use_quota=True,user_id='5bef163e54f643ff8beeecc20130d09e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Creating volume c6f42724-c650-497b-9fa6-4c94608f413a {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:24:27 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:24:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:28 devstack quobyte-client[83313]: System call of process 94791 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:28 devstack quobyte-client[83313]: System call of process 94791 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:28 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=86, name=volume-c6f42724-c650-497b-9fa6-4c94608f413a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:24:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a 1073741824" returned: 0 in 0.436s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a" returned: 0 in 0.123s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] <== create_volume: return (631ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:24:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.644s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:24:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3415af7-b1fa-4db9-b290-8df759a8fd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f42724-c650-497b-9fa6-4c94608f413a', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:24:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28551de5-6378-4684-b70b-90e2e6cc91c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:24:28 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Volume volume-c6f42724-c650-497b-9fa6-4c94608f413a (c6f42724-c650-497b-9fa6-4c94608f413a): created successfully Sep 22 11:24:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28551de5-6378-4684-b70b-90e2e6cc91c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:24:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Flow 'volume_create_manager' (a41ef069-5636-48ec-bb0f-e210861fee4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:24:28 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-9954a6a6-f67b-437b-be83-5ae3e10032da tempest-VolumesExtendTest-375823913 None] Created volume successfully. Sep 22 11:24:30 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:24:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:24:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:24:30 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] Creating offline snapshot f5755352-f4cc-48ad-8932-6bf1a2b70dcf of volume c6f42724-c650-497b-9fa6-4c94608f413a {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:24:30 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea6167c-3a97-4af7-8afe-0b12ada37262]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:24:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:30 devstack quobyte-client[83313]: System call of process 94796 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a" returned: 0 in 0.620s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.f5755352-f4cc-48ad-8932-6bf1a2b70dcf 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:31 devstack quobyte-client[83313]: System call of process 94809 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:31 devstack quobyte-client[83313]: System call of process 94809 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:31 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=87, name=volume-c6f42724-c650-497b-9fa6-4c94608f413a.f5755352-f4cc-48ad-8932-6bf1a2b70dcf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:24:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.f5755352-f4cc-48ad-8932-6bf1a2b70dcf 1G" returned: 0 in 1.035s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c6f42724-c650-497b-9fa6-4c94608f413a -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.f5755352-f4cc-48ad-8932-6bf1a2b70dcf {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:32 devstack quobyte-client[83313]: System call of process 94842 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:32 devstack quobyte-client[83313]: System call of process 94842 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:32 devstack quobyte-client[83313]: System call of process 94842 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] CMD "qemu-img rebase -u -b volume-c6f42724-c650-497b-9fa6-4c94608f413a -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.f5755352-f4cc-48ad-8932-6bf1a2b70dcf" returned: 0 in 0.267s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:32 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.f5755352-f4cc-48ad-8932-6bf1a2b70dcf is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:24:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.f5755352-f4cc-48ad-8932-6bf1a2b70dcf {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.f5755352-f4cc-48ad-8932-6bf1a2b70dcf" returned: 0 in 0.154s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:32 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:24:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.f5755352-f4cc-48ad-8932-6bf1a2b70dcf {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.f5755352-f4cc-48ad-8932-6bf1a2b70dcf" returned: 0 in 0.216s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.info" returned: 0 in 0.121s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:33 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:24:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.info" returned: 0 in 0.111s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.974s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:24:33 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-98da359f-b110-4296-9d1d-9a1b0274eb42 tempest-VolumesExtendTest-375823913 None] Create snapshot completed successfully Sep 22 11:24:35 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-d320f422-e4c6-4ff2-90fa-a3985587ae06 tempest-VolumesExtendTest-375823913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:24:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d320f422-e4c6-4ff2-90fa-a3985587ae06 tempest-VolumesExtendTest-375823913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:24:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d320f422-e4c6-4ff2-90fa-a3985587ae06 tempest-VolumesExtendTest-375823913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.007s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:24:35 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f943fcb2-a163-4a1e-952d-0d17db6d187f]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:24:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d320f422-e4c6-4ff2-90fa-a3985587ae06 tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:35 devstack quobyte-client[83313]: System call of process 94854 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:35 devstack quobyte-client[83313]: System call of process 94854 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d320f422-e4c6-4ff2-90fa-a3985587ae06 tempest-VolumesExtendTest-375823913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a" returned: 0 in 0.949s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d320f422-e4c6-4ff2-90fa-a3985587ae06 tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.f5755352-f4cc-48ad-8932-6bf1a2b70dcf 2G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:36 devstack quobyte-client[83313]: System call of process 94857 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:36 devstack quobyte-client[83313]: System call of process 94857 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:36 devstack quobyte-client[83313]: System call of process 94857 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:36 devstack quobyte-client[83313]: System call of process 94857 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d320f422-e4c6-4ff2-90fa-a3985587ae06 tempest-VolumesExtendTest-375823913 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.f5755352-f4cc-48ad-8932-6bf1a2b70dcf 2G" returned: 0 in 0.355s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d320f422-e4c6-4ff2-90fa-a3985587ae06 tempest-VolumesExtendTest-375823913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.561s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:24:37 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-d320f422-e4c6-4ff2-90fa-a3985587ae06 tempest-VolumesExtendTest-375823913 None] Extend volume completed successfully. Sep 22 11:24:37 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] Acquiring lock "cinder-f5755352-f4cc-48ad-8932-6bf1a2b70dcf-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:24:37 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] Lock "cinder-f5755352-f4cc-48ad-8932-6bf1a2b70dcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:24:37 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:24:37 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] Acquiring lock "cinder-quobyte-c6f42724-c650-497b-9fa6-4c94608f413a" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:24:37 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] Lock "cinder-quobyte-c6f42724-c650-497b-9fa6-4c94608f413a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:24:37 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] Acquiring lock "cinder-quobyte-f5755352-f4cc-48ad-8932-6bf1a2b70dcf" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:24:37 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] Lock "cinder-quobyte-f5755352-f4cc-48ad-8932-6bf1a2b70dcf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:24:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] Deleting offline snapshot f5755352-f4cc-48ad-8932-6bf1a2b70dcf of volume c6f42724-c650-497b-9fa6-4c94608f413a {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:24:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] snapshot_file for this snap is: volume-c6f42724-c650-497b-9fa6-4c94608f413a.f5755352-f4cc-48ad-8932-6bf1a2b70dcf {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:24:37 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e9358f-0402-40a9-9c6f-7f5aa9b729f6]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:24:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.f5755352-f4cc-48ad-8932-6bf1a2b70dcf {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.f5755352-f4cc-48ad-8932-6bf1a2b70dcf" returned: 0 in 0.413s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:38 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6f42724-c650-497b-9fa6-4c94608f413a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:24:38 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[549ea07a-f757-4c3d-b8e2-b5cb5edfa806]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:24:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:38 devstack quobyte-client[83313]: System call of process 94864 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:38 devstack quobyte-client[83313]: System call of process 94864 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a" returned: 0 in 0.658s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.f5755352-f4cc-48ad-8932-6bf1a2b70dcf {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:39 devstack quobyte-client[83313]: System call of process 94897 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:39 devstack quobyte-client[83313]: System call of process 94897 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.f5755352-f4cc-48ad-8932-6bf1a2b70dcf" returned: 0 in 0.395s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.f5755352-f4cc-48ad-8932-6bf1a2b70dcf {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a.f5755352-f4cc-48ad-8932-6bf1a2b70dcf" returned: 0 in 0.145s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] Lock "cinder-quobyte-f5755352-f4cc-48ad-8932-6bf1a2b70dcf" released by "_delete_snapshot" :: held 2.005s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:24:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] Lock "cinder-quobyte-c6f42724-c650-497b-9fa6-4c94608f413a" released by "delete_snapshot" :: held 2.035s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:24:39 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] Created reservations ['20744f2f-8540-48a5-b8c7-9fa9821edcd4', '4b9e4adb-4402-468b-8dd5-90b76d4bc1b7', '3cf112cb-ca38-4fee-8eaa-fad79f98c756', 'a13dea64-5076-47c6-9ef2-f18d4f57dc90'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:24:40 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] Delete snapshot completed successfully. Sep 22 11:24:40 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f65a6909-4579-4759-8cf4-e4ef455d4a0c tempest-VolumesExtendTest-375823913 None] Lock "cinder-f5755352-f4cc-48ad-8932-6bf1a2b70dcf-delete_snapshot" released by "delete_snapshot" :: held 2.534s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:24:40 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] Acquiring lock "cinder-c6f42724-c650-497b-9fa6-4c94608f413a-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:24:40 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] Lock "cinder-c6f42724-c650-497b-9fa6-4c94608f413a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:24:41 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:24:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] Acquiring lock "cinder-quobyte-c6f42724-c650-497b-9fa6-4c94608f413a" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:24:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] Lock "cinder-quobyte-c6f42724-c650-497b-9fa6-4c94608f413a" acquired by "delete_volume" :: waited 0.027s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:24:41 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[65728160-8c88-4922-993a-a4c666b3c35f]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:24:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:41 devstack quobyte-client[83313]: System call of process 94903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:41 devstack quobyte-client[83313]: System call of process 94903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a" returned: 0 in 0.568s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6f42724-c650-497b-9fa6-4c94608f413a" returned: 0 in 0.173s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:42 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] Lock "cinder-quobyte-c6f42724-c650-497b-9fa6-4c94608f413a" released by "delete_volume" :: held 1.019s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:24:42 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] Acquiring lock "cinder-a0418d6a-f624-4ab4-85c7-15b403cc858f-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:24:42 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] Lock "cinder-a0418d6a-f624-4ab4-85c7-15b403cc858f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:24:42 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] Created reservations ['a6ec628a-9d45-48d8-9e66-1440705f0a01', 'dbfed132-a7ec-4c2a-ba40-f2cdcebd962d', '5d7f3bb1-0a32-4ade-88b6-62f4e9777e90', '6863b370-b728-4415-ab29-57e21d8b3876'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:24:42 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:24:42 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] Acquiring lock "cinder-quobyte-a0418d6a-f624-4ab4-85c7-15b403cc858f" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:24:42 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] Lock "cinder-quobyte-a0418d6a-f624-4ab4-85c7-15b403cc858f" acquired by "delete_volume" :: waited 0.026s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:24:42 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[40615d55-eccb-41fc-a12f-9416de64d9f8]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:24:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a0418d6a-f624-4ab4-85c7-15b403cc858f {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:24:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.062s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:24:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:24:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:24:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:24:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:43 devstack quobyte-client[83313]: System call of process 94907 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:43 devstack quobyte-client[83313]: System call of process 94907 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:43 devstack quobyte-client[83313]: System call of process 94907 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:43 devstack quobyte-client[83313]: System call of process 94907 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:43 devstack quobyte-client[83313]: System call of process 94907 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a0418d6a-f624-4ab4-85c7-15b403cc858f" returned: 0 in 0.719s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a0418d6a-f624-4ab4-85c7-15b403cc858f {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.286s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:43 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:24:43 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] Deleted volume successfully. Sep 22 11:24:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a0418d6a-f624-4ab4-85c7-15b403cc858f" returned: 0 in 0.403s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] Lock "cinder-quobyte-a0418d6a-f624-4ab4-85c7-15b403cc858f" released by "delete_volume" :: held 1.290s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:24:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ea6e9257-0c23-44bf-8e30-6b20bd221605 tempest-VolumesExtendTest-375823913 None] Lock "cinder-c6f42724-c650-497b-9fa6-4c94608f413a-delete_volume" released by "delete_volume" :: held 3.231s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:24:44 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] Created reservations ['0234f46a-f2bc-4b43-a4ad-f7f8ae0bfe06', '368c9103-85c3-41d4-b1d0-347f36043224', 'd2dc717a-cb52-4bbd-86cc-45530446fac5', '0258f4a9-afe5-4e8f-a64d-12b09a9f40c3'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:24:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:24:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:24:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:24:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:24:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:24:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.112s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:44 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:24:44 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] Deleted volume successfully. Sep 22 11:24:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-046b270a-d971-4ebc-850d-d9b9298d5c6b tempest-AttachVolumeNegativeTest-524744203 None] Lock "cinder-a0418d6a-f624-4ab4-85c7-15b403cc858f-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:24:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] Acquiring lock "cinder-08d9ef29-6e98-4472-bfe6-1310a2bfff58-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:24:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] Lock "cinder-08d9ef29-6e98-4472-bfe6-1310a2bfff58-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:24:45 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:24:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] Acquiring lock "cinder-quobyte-08d9ef29-6e98-4472-bfe6-1310a2bfff58" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:24:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] Lock "cinder-quobyte-08d9ef29-6e98-4472-bfe6-1310a2bfff58" acquired by "delete_volume" :: waited 0.014s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:24:45 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1acc84-1c6e-42fc-a744-03044746c21e]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:24:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-08d9ef29-6e98-4472-bfe6-1310a2bfff58 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:45 devstack quobyte-client[83313]: System call of process 94914 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-08d9ef29-6e98-4472-bfe6-1310a2bfff58" returned: 0 in 0.489s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-08d9ef29-6e98-4472-bfe6-1310a2bfff58 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-08d9ef29-6e98-4472-bfe6-1310a2bfff58" returned: 0 in 0.173s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:46 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] Lock "cinder-quobyte-08d9ef29-6e98-4472-bfe6-1310a2bfff58" released by "delete_volume" :: held 0.862s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:24:46 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] Created reservations ['e3d5dc3d-9097-4f5b-ba41-f2512e4452b9', '4d617f10-b499-446d-ac64-32571e988462', 'f50e22d0-6331-44cb-bc6a-29a8dd35b856', 'bbc18023-3f50-4a57-9b5d-881353895cda'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:24:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:24:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:24:46 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:24:46 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:24:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:24:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.178s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:47 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:24:47 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] Deleted volume successfully. Sep 22 11:24:47 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8644eb8f-caf8-4c43-973d-60e3d2115a1e tempest-AttachVolumeNegativeTest-524744203 None] Lock "cinder-08d9ef29-6e98-4472-bfe6-1310a2bfff58-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:24:47 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] Acquiring lock "cinder-1b4fec80-02f3-43fe-8c86-67bee366440b-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:24:47 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] Lock "cinder-1b4fec80-02f3-43fe-8c86-67bee366440b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:24:47 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:24:47 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] Acquiring lock "cinder-quobyte-1b4fec80-02f3-43fe-8c86-67bee366440b" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:24:47 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] Lock "cinder-quobyte-1b4fec80-02f3-43fe-8c86-67bee366440b" acquired by "delete_volume" :: waited 0.016s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:24:48 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59ef4ae-d416-4503-9e0f-17556660961a]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:24:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1b4fec80-02f3-43fe-8c86-67bee366440b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:48 devstack quobyte-client[83313]: System call of process 94919 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:24:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1b4fec80-02f3-43fe-8c86-67bee366440b" returned: 0 in 0.509s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1b4fec80-02f3-43fe-8c86-67bee366440b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-1b4fec80-02f3-43fe-8c86-67bee366440b" returned: 0 in 0.132s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] Lock "cinder-quobyte-1b4fec80-02f3-43fe-8c86-67bee366440b" released by "delete_volume" :: held 0.862s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:24:49 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] Created reservations ['5d77b6cf-c4a2-4ce1-826f-d3a2158db27f', '75cb542e-7b02-4555-bd49-18ea0bc3f470', '3cab3e5a-4509-4a96-a22b-6e4e6027dd18', '6efd4de3-c994-47f4-bf71-37afe0350e04'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:24:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:24:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:24:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:24:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:24:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:24:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:24:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.107s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:24:49 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:24:49 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] Deleted volume successfully. Sep 22 11:24:49 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-22ac3a36-9055-4f1a-b3fe-7e399644d0e3 tempest-AttachVolumeNegativeTest-524744203 None] Lock "cinder-1b4fec80-02f3-43fe-8c86-67bee366440b-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:24:59 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=62,cinder:SELECT=39,cinder:INSERT=12,cinder:DELETE=3 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:24:59 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=50,cinder:UPDATE=52,cinder:INSERT=25,cinder:DELETE=5 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:25:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8e1bd741-e970-40d3-aa3a-424bc7b69b71 tempest-BackendsCapabilitiesAdminTestsJSON-619202319 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144821166992, 'free_capacity_gb': 924.9144821166992, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83310) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 22 11:25:08 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-1463316b-3506-49ce-be60-71587ee005a2 tempest-BackendsCapabilitiesAdminTestsJSON-619202319 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144821166992, 'free_capacity_gb': 924.9144821166992, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83310) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 22 11:25:16 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-9e0f073a-a5f2-4b38-9b7f-c919260d63aa tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:25:16 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-9e0f073a-a5f2-4b38-9b7f-c919260d63aa tempest-GroupSnapshotsTest-527905842 None] Group tempest-GroupSnapshotsTest-Group-161286460: creating Sep 22 11:25:16 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-9e0f073a-a5f2-4b38-9b7f-c919260d63aa tempest-GroupSnapshotsTest-527905842 None] Group tempest-GroupSnapshotsTest-Group-161286460: created successfully Sep 22 11:25:16 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-9e0f073a-a5f2-4b38-9b7f-c919260d63aa tempest-GroupSnapshotsTest-527905842 None] Create group completed successfully. Sep 22 11:25:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:25:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:25:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:25:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.181s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:25:18 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Flow 'volume_create_manager' (ce6ea989-f648-4943-9bb2-210c7f00edd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdcff7e3-d176-44af-87e1-7d4469891910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdcff7e3-d176-44af-87e1-7d4469891910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2014247344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2d332218-bf7c-43c9-98db-da19754f6b33,host='devstack@QuobyteHD#QuobyteHD',id=bcba43e1-73be-493c-b73c-c28026ad7d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f855e1f6fe0482e8729d6d0d0f559d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:25:18Z,use_quota=True,user_id='d5f72ebf667c4c72bf94f8383eea025c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cefcc9cd-dd04-41be-9985-0da7d289083a),volume_type_id=cefcc9cd-dd04-41be-9985-0da7d289083a)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1185ff68-6eb4-4fa7-9760-83ce6a2cd904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1185ff68-6eb4-4fa7-9760-83ce6a2cd904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741373be-ffd8-4e5b-995e-5091778a44f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741373be-ffd8-4e5b-995e-5091778a44f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcba43e1-73be-493c-b73c-c28026ad7d85', 'volume_name': 'volume-bcba43e1-73be-493c-b73c-c28026ad7d85', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b8ff59e-b7d9-4b9c-9844-fc5594f147af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b8ff59e-b7d9-4b9c-9844-fc5594f147af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295720fe-b005-4d8c-8085-e9da5e5ee138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:18 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Volume bcba43e1-73be-493c-b73c-c28026ad7d85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcba43e1-73be-493c-b73c-c28026ad7d85', 'volume_size': 1} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2d332218-bf7c-43c9-98db-da19754f6b33,created_at=2025-09-22T09:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2014247344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2d332218-bf7c-43c9-98db-da19754f6b33,host='devstack@QuobyteHD#QuobyteHD',id=bcba43e1-73be-493c-b73c-c28026ad7d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f855e1f6fe0482e8729d6d0d0f559d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:25:18Z,use_quota=True,user_id='d5f72ebf667c4c72bf94f8383eea025c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cefcc9cd-dd04-41be-9985-0da7d289083a),volume_type_id=cefcc9cd-dd04-41be-9985-0da7d289083a)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Creating volume bcba43e1-73be-493c-b73c-c28026ad7d85 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:25:18 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:18 devstack quobyte-client[83313]: System call of process 95162 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:18 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=89, name=volume-bcba43e1-73be-493c-b73c-c28026ad7d85, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85 1073741824" returned: 0 in 0.436s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85" returned: 0 in 0.163s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:19 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] <== create_volume: return (688ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:25:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295720fe-b005-4d8c-8085-e9da5e5ee138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcba43e1-73be-493c-b73c-c28026ad7d85', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ec4ef5-6666-40e4-b10e-e22317eb3c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:19 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Volume volume-bcba43e1-73be-493c-b73c-c28026ad7d85 (bcba43e1-73be-493c-b73c-c28026ad7d85): created successfully Sep 22 11:25:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ec4ef5-6666-40e4-b10e-e22317eb3c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Flow 'volume_create_manager' (ce6ea989-f648-4943-9bb2-210c7f00edd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:25:19 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-ae39d118-a763-4f7a-89da-583b669a17cf tempest-GroupSnapshotsTest-527905842 None] Created volume successfully. Sep 22 11:25:20 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Flow 'volume_create_manager' (e63e51e7-506c-48fb-935c-20603401e6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d663ec2-62f3-4382-a993-862050b0d47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d663ec2-62f3-4382-a993-862050b0d47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1756373963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1b2aa5-fa7a-4585-9173-283707840fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a063a2c8d74405ca6aa8aaeb849b6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:25:20Z,use_quota=True,user_id='51a5f210cffd41b8b26f2e9830ded448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8675751-8fb7-4970-b263-3d51ed2261ee),volume_type_id=d8675751-8fb7-4970-b263-3d51ed2261ee)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ec2faf-c4ae-43a9-b020-16495379dd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ec2faf-c4ae-43a9-b020-16495379dd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85f6b1f-8d03-44cf-bc5d-80b2f2843b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85f6b1f-8d03-44cf-bc5d-80b2f2843b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad1b2aa5-fa7a-4585-9173-283707840fa4', 'volume_name': 'volume-ad1b2aa5-fa7a-4585-9173-283707840fa4', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd7b6ff-fc08-4582-8ba3-d3e784d80413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd7b6ff-fc08-4582-8ba3-d3e784d80413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63fb2f93-602b-4da8-9272-415edd2968e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:20 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Volume ad1b2aa5-fa7a-4585-9173-283707840fa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad1b2aa5-fa7a-4585-9173-283707840fa4', 'volume_size': 1} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1756373963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1b2aa5-fa7a-4585-9173-283707840fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a063a2c8d74405ca6aa8aaeb849b6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:25:20Z,use_quota=True,user_id='51a5f210cffd41b8b26f2e9830ded448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8675751-8fb7-4970-b263-3d51ed2261ee),volume_type_id=d8675751-8fb7-4970-b263-3d51ed2261ee)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Creating volume ad1b2aa5-fa7a-4585-9173-283707840fa4 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:25:20 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:25:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ad1b2aa5-fa7a-4585-9173-283707840fa4 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:20 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=90, name=volume-ad1b2aa5-fa7a-4585-9173-283707840fa4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:25:20 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] GroupSnapshot 1bf57460-36c2-44ce-8296-d67b2b006510: creating. Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ad1b2aa5-fa7a-4585-9173-283707840fa4 1073741824" returned: 0 in 0.828s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ad1b2aa5-fa7a-4585-9173-283707840fa4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:21 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Flow 'volume_create_manager' (6025069d-e699-4630-82b3-e1b877cb0dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bc3e27-d412-4cd6-8225-18fd54e254c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ad1b2aa5-fa7a-4585-9173-283707840fa4" returned: 0 in 0.592s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] <== create_volume: return (1475ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bc3e27-d412-4cd6-8225-18fd54e254c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1170659790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16f6719-ec36-4496-8cb8-9119be9ab2d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a063a2c8d74405ca6aa8aaeb849b6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:25:20Z,use_quota=True,user_id='51a5f210cffd41b8b26f2e9830ded448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b17db164-2b01-4717-b49e-f886703d6be8),volume_type_id=b17db164-2b01-4717-b49e-f886703d6be8)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4296bfa0-60e3-4a15-ae1e-224f509d5bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4296bfa0-60e3-4a15-ae1e-224f509d5bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28226377-067c-4493-aaf8-d0ae20e1eecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28226377-067c-4493-aaf8-d0ae20e1eecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a16f6719-ec36-4496-8cb8-9119be9ab2d0', 'volume_name': 'volume-a16f6719-ec36-4496-8cb8-9119be9ab2d0', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7e5b22-eb24-4220-9c9b-69e2a25d94e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7e5b22-eb24-4220-9c9b-69e2a25d94e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deda5462-88f7-468d-8354-8b0ae9f63d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:21 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Volume a16f6719-ec36-4496-8cb8-9119be9ab2d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a16f6719-ec36-4496-8cb8-9119be9ab2d0', 'volume_size': 1} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1170659790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16f6719-ec36-4496-8cb8-9119be9ab2d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a063a2c8d74405ca6aa8aaeb849b6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:25:20Z,use_quota=True,user_id='51a5f210cffd41b8b26f2e9830ded448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b17db164-2b01-4717-b49e-f886703d6be8),volume_type_id=b17db164-2b01-4717-b49e-f886703d6be8)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Creating volume a16f6719-ec36-4496-8cb8-9119be9ab2d0 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:25:21 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:25:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a16f6719-ec36-4496-8cb8-9119be9ab2d0 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:21 devstack quobyte-client[83313]: System call of process 95173 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:22 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=91, name=volume-a16f6719-ec36-4496-8cb8-9119be9ab2d0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:25:22 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:25:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] Group snapshot 1bf57460-36c2-44ce-8296-d67b2b006510: creating. {{(pid=83310) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 22 11:25:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63fb2f93-602b-4da8-9272-415edd2968e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad1b2aa5-fa7a-4585-9173-283707840fa4', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7eee18-fb4d-419e-9bd4-e31184cebabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a16f6719-ec36-4496-8cb8-9119be9ab2d0 1073741824" returned: 0 in 0.523s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a16f6719-ec36-4496-8cb8-9119be9ab2d0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:22 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Volume volume-ad1b2aa5-fa7a-4585-9173-283707840fa4 (ad1b2aa5-fa7a-4585-9173-283707840fa4): created successfully Sep 22 11:25:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7eee18-fb4d-419e-9bd4-e31184cebabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Flow 'volume_create_manager' (e63e51e7-506c-48fb-935c-20603401e6da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:25:22 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:25:22 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:25:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Flow 'volume_create_manager' (c748e3a9-e588-4ba2-b15f-6328f717f363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:25:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a666c9-76b9-4070-a916-ece2ea7f037a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a16f6719-ec36-4496-8cb8-9119be9ab2d0" returned: 0 in 0.458s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] <== create_volume: return (1001ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:25:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.613s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] Creating offline snapshot 40592370-0695-4fbf-b2b5-e1fcbeee48c0 of volume bcba43e1-73be-493c-b73c-c28026ad7d85 {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:25:22 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-ac31544a-cc43-45ae-8369-c234d147adb5 tempest-TestInstancesWithCinderVolumes-450250349 None] Created volume successfully. Sep 22 11:25:22 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33319b6-5112-46fb-8ef6-6f943becad3f]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:25:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a666c9-76b9-4070-a916-ece2ea7f037a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-726050809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920c9402-d08e-4926-aaf9-80358c9dd996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a063a2c8d74405ca6aa8aaeb849b6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:25:22Z,use_quota=True,user_id='51a5f210cffd41b8b26f2e9830ded448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6de05cda-96b4-42c6-8ead-da4c7253d11f),volume_type_id=6de05cda-96b4-42c6-8ead-da4c7253d11f)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196b0287-2d27-4dd4-a0b6-d7cafae4f44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196b0287-2d27-4dd4-a0b6-d7cafae4f44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96070c41-7e50-4c92-babe-9953739aaedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:23 devstack cinder-volume[83310]: DEBUG cinder.image.glance [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Creating Keystone auth plugin from conf {{(pid=83310) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 22 11:25:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deda5462-88f7-468d-8354-8b0ae9f63d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a16f6719-ec36-4496-8cb8-9119be9ab2d0', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934306a6-d32e-41fc-a4af-f3234d7c6e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:23 devstack quobyte-client[83313]: System call of process 95177 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:23 devstack quobyte-client[83313]: System call of process 95177 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85" returned: 0 in 0.651s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.40592370-0695-4fbf-b2b5-e1fcbeee48c0 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:23 devstack quobyte-client[83313]: System call of process 95180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:23 devstack quobyte-client[83313]: System call of process 95180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:23 devstack quobyte-client[83313]: System call of process 95180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:23 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Volume volume-a16f6719-ec36-4496-8cb8-9119be9ab2d0 (a16f6719-ec36-4496-8cb8-9119be9ab2d0): created successfully Sep 22 11:25:23 devstack quobyte-client[83313]: System call of process 95180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:23 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=92, name=volume-bcba43e1-73be-493c-b73c-c28026ad7d85.40592370-0695-4fbf-b2b5-e1fcbeee48c0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:25:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934306a6-d32e-41fc-a4af-f3234d7c6e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Flow 'volume_create_manager' (6025069d-e699-4630-82b3-e1b877cb0dc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:25:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.40592370-0695-4fbf-b2b5-e1fcbeee48c0 1G" returned: 0 in 0.532s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bcba43e1-73be-493c-b73c-c28026ad7d85 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.40592370-0695-4fbf-b2b5-e1fcbeee48c0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:24 devstack quobyte-client[83313]: System call of process 95184 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:24 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-eb69edb2-1bbf-46e4-8018-43b57c43ad2c tempest-TestInstancesWithCinderVolumes-450250349 None] Created volume successfully. Sep 22 11:25:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] CMD "qemu-img rebase -u -b volume-bcba43e1-73be-493c-b73c-c28026ad7d85 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.40592370-0695-4fbf-b2b5-e1fcbeee48c0" returned: 0 in 0.399s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.40592370-0695-4fbf-b2b5-e1fcbeee48c0 is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:25:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.40592370-0695-4fbf-b2b5-e1fcbeee48c0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96070c41-7e50-4c92-babe-9953739aaedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '920c9402-d08e-4926-aaf9-80358c9dd996', 'volume_name': 'volume-920c9402-d08e-4926-aaf9-80358c9dd996', 'volume_size': 1, 'image_id': 'f17b25b7-a802-418a-9d2a-515574ca1be4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f17b25b7-a802-418a-9d2a-515574ca1be4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2126641744', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6a063a2c8d74405ca6aa8aaeb849b6ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f17b25b7-a802-418a-9d2a-515574ca1be4', 'created_at': datetime.datetime(2025, 9, 22, 9, 25, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 9, 25, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f17b25b7-a802-418a-9d2a-515574ca1be4/file', 'properties': {}}, 'image_service': }' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a76e41e-0e94-4707-b7fd-d2e4985926b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a76e41e-0e94-4707-b7fd-d2e4985926b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b8deaa-5ada-47f9-be9a-cab1c4cf4267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:24 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Volume 920c9402-d08e-4926-aaf9-80358c9dd996: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-920c9402-d08e-4926-aaf9-80358c9dd996', 'volume_size': 1, 'image_id': 'f17b25b7-a802-418a-9d2a-515574ca1be4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f17b25b7-a802-418a-9d2a-515574ca1be4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2126641744', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6a063a2c8d74405ca6aa8aaeb849b6ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f17b25b7-a802-418a-9d2a-515574ca1be4', 'created_at': datetime.datetime(2025, 9, 22, 9, 25, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 9, 25, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f17b25b7-a802-418a-9d2a-515574ca1be4/file', 'properties': {}}, 'image_service': } Sep 22 11:25:24 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Cloning 920c9402-d08e-4926-aaf9-80358c9dd996 from image f17b25b7-a802-418a-9d2a-515574ca1be4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f17b25b7-a802-418a-9d2a-515574ca1be4', 'metadata': {}}]). {{(pid=83310) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 22 11:25:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.40592370-0695-4fbf-b2b5-e1fcbeee48c0" returned: 0 in 0.387s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85 -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:25:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.40592370-0695-4fbf-b2b5-e1fcbeee48c0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.40592370-0695-4fbf-b2b5-e1fcbeee48c0" returned: 0 in 0.174s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.info" returned: 0 in 0.159s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:25 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:25:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.info" returned: 0 in 0.113s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.648s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:25 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-fef4b7b5-748f-41d3-9639-bcb25c5b0744 tempest-GroupSnapshotsTest-527905842 None] group_snapshot 1bf57460-36c2-44ce-8296-d67b2b006510: created successfully Sep 22 11:25:27 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "cinder-quobyte-40592370-0695-4fbf-b2b5-e1fcbeee48c0-5fc19054-ced6-4970-b03c-734adec0a20d" by "_create_volume_from_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-40592370-0695-4fbf-b2b5-e1fcbeee48c0-5fc19054-ced6-4970-b03c-734adec0a20d" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Creating volume 5fc19054-ced6-4970-b03c-734adec0a20d from snapshot 40592370-0695-4fbf-b2b5-e1fcbeee48c0 {{(pid=83310) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "cinder-quobyte-5fc19054-ced6-4970-b03c-734adec0a20d" by "_copy_volume_from_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-5fc19054-ced6-4970-b03c-734adec0a20d" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] snapshot: 40592370-0695-4fbf-b2b5-e1fcbeee48c0, volume: 5fc19054-ced6-4970-b03c-734adec0a20d, {{(pid=83310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd140d6-cc3c-4516-ada8-8a572d9a02a3]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.40592370-0695-4fbf-b2b5-e1fcbeee48c0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:27 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f17b25b7-a802-418a-9d2a-515574ca1be4_ms9i3_s4devstack@QuobyteHD, size 20.69 MB, duration 3.08 sec {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 22 11:25:27 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Image download 20.69 MB at 6.73 MB/s Sep 22 11:25:28 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[67044fcd-176b-441d-a0e8-3295573d8f70]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:25:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f17b25b7-a802-418a-9d2a-515574ca1be4_ms9i3_s4devstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:28 devstack quobyte-client[83313]: System call of process 95193 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:28 devstack quobyte-client[83313]: System call of process 95193 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:28 devstack quobyte-client[83313]: System call of process 95193 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.40592370-0695-4fbf-b2b5-e1fcbeee48c0" returned: 0 in 0.606s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcba43e1-73be-493c-b73c-c28026ad7d85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:25:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85 {{(pid=83310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 22 11:25:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Creating direct copy from snapshot {{(pid=83310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 22 11:25:28 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d4241d-7d96-4f01-8cb2-5da9648cce6a]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:25:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:28 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f17b25b7-a802-418a-9d2a-515574ca1be4_ms9i3_s4devstack@QuobyteHD Sep 22 11:25:28 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 11:25:28 devstack quobyte-client[83313]: System call of process 95198 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85" returned: 0 in 0.526s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:28 devstack cinder-volume[83310]: DEBUG cinder.utils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5fc19054-ced6-4970-b03c-734adec0a20d not found in is_blk_device check {{(pid=83310) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 22 11:25:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5fc19054-ced6-4970-b03c-734adec0a20d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:29 devstack quobyte-client[83313]: System call of process 95202 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:29 devstack quobyte-client[83313]: System call of process 95202 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:29 devstack quobyte-client[83313]: System call of process 95202 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:29 devstack quobyte-client[83313]: System call of process 95202 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:29 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=94, name=volume-5fc19054-ced6-4970-b03c-734adec0a20d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:25:33 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Sep 22 11:25:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f17b25b7-a802-418a-9d2a-515574ca1be4_ms9i3_s4devstack@QuobyteHD" returned: 0 in 5.699s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:34 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Temporary image f17b25b7-a802-418a-9d2a-515574ca1be4 is fetched for user 51a5f210cffd41b8b26f2e9830ded448. {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 22 11:25:35 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b89e32-ffd5-41c9-aeec-610083058c4f]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:25:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f17b25b7-a802-418a-9d2a-515574ca1be4_ms9i3_s4devstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5fc19054-ced6-4970-b03c-734adec0a20d" returned: 0 in 7.485s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:36 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1fafb1-2b94-4c91-ba07-7f46aee41252]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:25:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:36 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f17b25b7-a802-418a-9d2a-515574ca1be4_ms9i3_s4devstack@QuobyteHD Sep 22 11:25:36 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 11:25:37 devstack quobyte-client[83313]: System call of process 95218 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:37 devstack quobyte-client[83313]: System call of process 95218 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:37 devstack quobyte-client[83313]: System call of process 95218 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:37 devstack quobyte-client[83313]: System call of process 95218 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85" returned: 0 in 0.854s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:37 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Image conversion details: src /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85, size 1024.00 MB, duration 7.52 sec, destination /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5fc19054-ced6-4970-b03c-734adec0a20d {{(pid=83310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 22 11:25:37 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Converted 1024.00 MB image at 136.16 MB/s Sep 22 11:25:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5fc19054-ced6-4970-b03c-734adec0a20d is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:25:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5fc19054-ced6-4970-b03c-734adec0a20d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5fc19054-ced6-4970-b03c-734adec0a20d" returned: 0 in 0.123s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:37 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-5fc19054-ced6-4970-b03c-734adec0a20d" released by "_copy_volume_from_snapshot" :: held 10.102s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:25:37 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-40592370-0695-4fbf-b2b5-e1fcbeee48c0-5fc19054-ced6-4970-b03c-734adec0a20d" released by "_create_volume_from_snapshot" :: held 10.158s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:25:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.228s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:38 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-154f0d54-a69d-47db-ab51-d827f9b9755f tempest-GroupSnapshotsTest-527905842 None] Create group from source-snapshot-1bf57460-36c2-44ce-8296-d67b2b006510 completed successfully. Sep 22 11:25:39 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:25:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "cinder-quobyte-5fc19054-ced6-4970-b03c-734adec0a20d" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:25:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-5fc19054-ced6-4970-b03c-734adec0a20d" acquired by "delete_volume" :: waited 0.041s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:25:39 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d0a5e5-aa29-4c2a-a291-5eb57af1d82b]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:25:39 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Sep 22 11:25:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5fc19054-ced6-4970-b03c-734adec0a20d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f17b25b7-a802-418a-9d2a-515574ca1be4_ms9i3_s4devstack@QuobyteHD" returned: 0 in 4.032s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.023s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-726050809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920c9402-d08e-4926-aaf9-80358c9dd996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a063a2c8d74405ca6aa8aaeb849b6ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:25:22Z,use_quota=True,user_id='51a5f210cffd41b8b26f2e9830ded448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6de05cda-96b4-42c6-8ead-da4c7253d11f),volume_type_id=6de05cda-96b4-42c6-8ead-da4c7253d11f)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:25:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Creating volume 920c9402-d08e-4926-aaf9-80358c9dd996 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:25:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:25:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:25:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:25:40 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:25:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:40 devstack quobyte-client[83313]: System call of process 95239 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:40 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=95, name=volume-920c9402-d08e-4926-aaf9-80358c9dd996, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:25:40 devstack quobyte-client[83313]: System call of process 95230 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5fc19054-ced6-4970-b03c-734adec0a20d" returned: 0 in 0.923s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5fc19054-ced6-4970-b03c-734adec0a20d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5fc19054-ced6-4970-b03c-734adec0a20d" returned: 0 in 0.193s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-5fc19054-ced6-4970-b03c-734adec0a20d" released by "delete_volume" :: held 1.499s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:25:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996 1073741824" returned: 0 in 1.200s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996" returned: 0 in 0.239s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] <== create_volume: return (1515ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:25:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:41 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Attempting download of f17b25b7-a802-418a-9d2a-515574ca1be4 ((None, [{'url': 'file:///opt/stack/data/glance/images/f17b25b7-a802-418a-9d2a-515574ca1be4', 'metadata': {}}])) to volume 920c9402-d08e-4926-aaf9-80358c9dd996. {{(pid=83310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 22 11:25:41 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] Created reservations ['8910d84a-6774-4a24-b14d-447cd5f0ac2c'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:25:41 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52e61e9-df69-4cd0-92a5-52000356b030]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:25:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f17b25b7-a802-418a-9d2a-515574ca1be4_zhceo45o {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:42 devstack cinder-volume[83310]: WARNING cinder.quota [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-445270285 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-445270285, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:25:42 devstack cinder-volume[83310]: WARNING cinder.quota [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-445270285 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-445270285, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:25:42 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] Created reservations ['a664ec74-429c-42b5-8118-536cbf237150', '71bc66b8-993a-41d4-ab0e-11871cc2f165', 'abbd42bf-6e83-4a5b-9847-e58052393293', 'c5dbae54-eeb7-4745-b060-3ab10384cf77'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:25:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f17b25b7-a802-418a-9d2a-515574ca1be4_zhceo45o" returned: 0 in 0.499s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f17b25b7-a802-418a-9d2a-515574ca1be4_zhceo45o {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.031s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:42 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:25:42 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:25:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f17b25b7-a802-418a-9d2a-515574ca1be4_zhceo45o" returned: 1 in 0.631s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f17b25b7-a802-418a-9d2a-515574ca1be4_zhceo45o' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:25:43 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4581016e-0e19-4179-984b-c55e7f81b876]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:25:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f17b25b7-a802-418a-9d2a-515574ca1be4_ms9i3_s4devstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:43 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] group_snapshot 1bf57460-36c2-44ce-8296-d67b2b006510: deleting Sep 22 11:25:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.523s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:43 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:25:43 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-5edd9351-9b13-46da-b6df-c41cd34ca977 tempest-GroupSnapshotsTest-527905842 None] Delete group completed successfully. Sep 22 11:25:43 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:25:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] group_snapshot 1bf57460-36c2-44ce-8296-d67b2b006510: deleting {{(pid=83310) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 22 11:25:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "cinder-quobyte-bcba43e1-73be-493c-b73c-c28026ad7d85" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:25:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-bcba43e1-73be-493c-b73c-c28026ad7d85" acquired by "delete_snapshot" :: waited 0.055s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:25:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "cinder-quobyte-40592370-0695-4fbf-b2b5-e1fcbeee48c0" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:25:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-40592370-0695-4fbf-b2b5-e1fcbeee48c0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:25:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] Deleting offline snapshot 40592370-0695-4fbf-b2b5-e1fcbeee48c0 of volume bcba43e1-73be-493c-b73c-c28026ad7d85 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:25:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] snapshot_file for this snap is: volume-bcba43e1-73be-493c-b73c-c28026ad7d85.40592370-0695-4fbf-b2b5-e1fcbeee48c0 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:25:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f17b25b7-a802-418a-9d2a-515574ca1be4_ms9i3_s4devstack@QuobyteHD" returned: 0 in 0.643s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:43 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] f17b25b7-a802-418a-9d2a-515574ca1be4 was qcow2, converting to raw {{(pid=83310) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 22 11:25:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f17b25b7-a802-418a-9d2a-515574ca1be4_ms9i3_s4devstack@QuobyteHD /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:43 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c58ef2-7328-423f-97f6-dca802f08e20]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:25:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.40592370-0695-4fbf-b2b5-e1fcbeee48c0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:43 devstack quobyte-client[83313]: System call of process 95274 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:43 devstack quobyte-client[83313]: System call of process 95274 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:43 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=95, name=volume-920c9402-d08e-4926-aaf9-80358c9dd996, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:25:44 devstack quobyte-client[83313]: System call of process 95277 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.40592370-0695-4fbf-b2b5-e1fcbeee48c0" returned: 0 in 0.625s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcba43e1-73be-493c-b73c-c28026ad7d85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:25:44 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d5d8ea-c478-4fed-9ae6-a6d7ee2296e9]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:25:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f17b25b7-a802-418a-9d2a-515574ca1be4_ms9i3_s4devstack@QuobyteHD /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996" returned: 0 in 1.234s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:44 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f17b25b7-a802-418a-9d2a-515574ca1be4_ms9i3_s4devstack@QuobyteHD, size 112.00 MB, duration 1.27 sec, destination /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996 {{(pid=83310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 22 11:25:44 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Converted 112.00 MB image at 88.47 MB/s Sep 22 11:25:45 devstack quobyte-client[83313]: System call of process 95287 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:45 devstack quobyte-client[83313]: System call of process 95287 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85" returned: 0 in 0.574s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:45 devstack quobyte-client[83313]: System call of process 95290 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.40592370-0695-4fbf-b2b5-e1fcbeee48c0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996 1G" returned: 0 in 0.237s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:45 devstack quobyte-client[83313]: System call of process 95293 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:45 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda2047d-a132-4078-b085-728e9efa82f4]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:25:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.40592370-0695-4fbf-b2b5-e1fcbeee48c0" returned: 0 in 0.347s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.40592370-0695-4fbf-b2b5-e1fcbeee48c0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85.40592370-0695-4fbf-b2b5-e1fcbeee48c0" returned: 0 in 0.114s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-40592370-0695-4fbf-b2b5-e1fcbeee48c0" released by "_delete_snapshot" :: held 2.144s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:25:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-bcba43e1-73be-493c-b73c-c28026ad7d85" released by "delete_snapshot" :: held 2.168s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:25:45 devstack quobyte-client[83313]: System call of process 95296 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996" returned: 0 in 0.601s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:46 devstack cinder-volume[83310]: WARNING cinder.quota [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-445270285 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-445270285, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:25:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996" returned: 1 in 0.552s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:25:46 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Downloaded image f17b25b7-a802-418a-9d2a-515574ca1be4 ((None, [{'url': 'file:///opt/stack/data/glance/images/f17b25b7-a802-418a-9d2a-515574ca1be4', 'metadata': {}}])) to volume 920c9402-d08e-4926-aaf9-80358c9dd996 successfully. {{(pid=83310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 22 11:25:46 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Temporary image f17b25b7-a802-418a-9d2a-515574ca1be4 for user 51a5f210cffd41b8b26f2e9830ded448 is deleted. {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 22 11:25:46 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Marking volume 920c9402-d08e-4926-aaf9-80358c9dd996 as bootable. {{(pid=83310) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 22 11:25:46 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] Created reservations ['bcc2fa0d-2d3a-4624-92ef-cfb0c18c5ff4', 'b8a70ad7-3100-4774-a132-78e7e271897c', '6e4ce320-7432-48f1-a49f-453901f92d5b', '4b742509-a7c4-4c8e-80e4-147a0e460a27'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:25:46 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Copying metadata from image f17b25b7-a802-418a-9d2a-515574ca1be4 to 920c9402-d08e-4926-aaf9-80358c9dd996. {{(pid=83310) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 11:25:46 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Creating volume glance metadata for volume 920c9402-d08e-4926-aaf9-80358c9dd996 backed by image f17b25b7-a802-418a-9d2a-515574ca1be4 with: {'image_id': 'f17b25b7-a802-418a-9d2a-515574ca1be4', 'image_name': 'tempest-scenario-img--2126641744', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83310) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 11:25:46 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b8deaa-5ada-47f9-be9a-cab1c4cf4267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-920c9402-d08e-4926-aaf9-80358c9dd996', 'volume_size': 1, 'image_id': 'f17b25b7-a802-418a-9d2a-515574ca1be4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f17b25b7-a802-418a-9d2a-515574ca1be4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2126641744', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6a063a2c8d74405ca6aa8aaeb849b6ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f17b25b7-a802-418a-9d2a-515574ca1be4', 'created_at': datetime.datetime(2025, 9, 22, 9, 25, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 9, 25, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f17b25b7-a802-418a-9d2a-515574ca1be4/file', 'properties': {}}, 'image_service': }' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:46 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c21e361-3254-476c-9866-c911be657f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:46 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Volume volume-920c9402-d08e-4926-aaf9-80358c9dd996 (920c9402-d08e-4926-aaf9-80358c9dd996): created successfully Sep 22 11:25:46 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c21e361-3254-476c-9866-c911be657f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:46 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Flow 'volume_create_manager' (c748e3a9-e588-4ba2-b15f-6328f717f363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:25:46 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-24a34956-ecb6-477d-9547-a2839bb4d8b4 tempest-TestInstancesWithCinderVolumes-450250349 None] Created volume successfully. Sep 22 11:25:46 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-d0981319-da21-4944-8191-ae63fa52b53c tempest-GroupSnapshotsTest-527905842 None] group_snapshot 1bf57460-36c2-44ce-8296-d67b2b006510: deleted successfully Sep 22 11:25:47 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:25:47 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "cinder-quobyte-bcba43e1-73be-493c-b73c-c28026ad7d85" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:25:47 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-bcba43e1-73be-493c-b73c-c28026ad7d85" acquired by "delete_volume" :: waited 0.044s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:25:48 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8935682e-84f0-4762-aa50-21d957c51c52]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:25:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85" returned: 0 in 0.520s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-bcba43e1-73be-493c-b73c-c28026ad7d85" returned: 0 in 0.136s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-bcba43e1-73be-493c-b73c-c28026ad7d85" released by "delete_volume" :: held 0.884s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:25:49 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] Created reservations ['4ba38095-7f56-46e3-85f9-c90beb33540f'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:25:49 devstack cinder-volume[83310]: WARNING cinder.db.sqlalchemy.api [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-445270285'] Sep 22 11:25:49 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] Created reservations ['54df47c1-0c0a-4c3b-9695-72ab92222f0e', '44a75ee4-dc7a-4cb9-9d9c-9c92481b2d4e', '0a38d4db-41d6-440b-a1cb-15307a0016dd', '9bfc33ba-21ee-4e2f-a58a-950eb81f13e8'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:25:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:25:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:25:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.099s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:50 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:25:50 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-b7f07be4-623f-4f4d-942c-25915d17876b tempest-GroupSnapshotsTest-527905842 None] Delete group completed successfully. Sep 22 11:25:51 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-99773acb-79f2-44b6-94b2-cc07eb0fb05d tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:25:51 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-99773acb-79f2-44b6-94b2-cc07eb0fb05d tempest-GroupSnapshotsTest-527905842 None] Group tempest-GroupSnapshotsTest-Group-2033343034: creating Sep 22 11:25:51 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-99773acb-79f2-44b6-94b2-cc07eb0fb05d tempest-GroupSnapshotsTest-527905842 None] Group tempest-GroupSnapshotsTest-Group-2033343034: created successfully Sep 22 11:25:51 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-99773acb-79f2-44b6-94b2-cc07eb0fb05d tempest-GroupSnapshotsTest-527905842 None] Create group completed successfully. Sep 22 11:25:52 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Flow 'volume_create_manager' (a67d3e6e-ba88-4f12-8b09-a9d01f7b03fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cfab22-2b52-4f37-ba9f-2c25fa226f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cfab22-2b52-4f37-ba9f-2c25fa226f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1878405341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ee3f0ed-eed5-4bac-960d-3e922cc2746f,host='devstack@QuobyteHD#QuobyteHD',id=c502307f-2fc3-413f-8fc4-f0fabe41f8b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f855e1f6fe0482e8729d6d0d0f559d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:25:53Z,use_quota=True,user_id='d5f72ebf667c4c72bf94f8383eea025c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddd32b93-212b-4ab5-967e-561714abf937),volume_type_id=ddd32b93-212b-4ab5-967e-561714abf937)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b34af5-ff68-45e6-a215-3b827b0abcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b34af5-ff68-45e6-a215-3b827b0abcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb97cc0e-2b89-4864-a10e-48e9f2b650bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb97cc0e-2b89-4864-a10e-48e9f2b650bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c502307f-2fc3-413f-8fc4-f0fabe41f8b0', 'volume_name': 'volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6743980b-6063-444b-ab79-4bfbfd67e042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6743980b-6063-444b-ab79-4bfbfd67e042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2bfc96c-10b5-4c3f-bfec-be1b8d7f25c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:52 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Volume c502307f-2fc3-413f-8fc4-f0fabe41f8b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0', 'volume_size': 1} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2ee3f0ed-eed5-4bac-960d-3e922cc2746f,created_at=2025-09-22T09:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1878405341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ee3f0ed-eed5-4bac-960d-3e922cc2746f,host='devstack@QuobyteHD#QuobyteHD',id=c502307f-2fc3-413f-8fc4-f0fabe41f8b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f855e1f6fe0482e8729d6d0d0f559d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:25:53Z,use_quota=True,user_id='d5f72ebf667c4c72bf94f8383eea025c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddd32b93-212b-4ab5-967e-561714abf937),volume_type_id=ddd32b93-212b-4ab5-967e-561714abf937)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Creating volume c502307f-2fc3-413f-8fc4-f0fabe41f8b0 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:25:52 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:25:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:53 devstack quobyte-client[83313]: System call of process 95308 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:53 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=96, name=volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:25:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0 1073741824" returned: 0 in 0.446s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0" returned: 0 in 0.091s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:53 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] <== create_volume: return (618ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:25:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.633s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:53 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2bfc96c-10b5-4c3f-bfec-be1b8d7f25c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:53 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (356e83ce-9737-4856-83ae-f9857060af44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:53 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Volume volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0 (c502307f-2fc3-413f-8fc4-f0fabe41f8b0): created successfully Sep 22 11:25:53 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (356e83ce-9737-4856-83ae-f9857060af44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:53 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Flow 'volume_create_manager' (a67d3e6e-ba88-4f12-8b09-a9d01f7b03fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:25:53 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-2f2ff3af-54f5-4dee-ba68-85d84c98a122 tempest-GroupSnapshotsTest-527905842 None] Created volume successfully. Sep 22 11:25:55 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:25:55 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:25:55 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Flow 'volume_create_manager' (0ad7102e-3ca9-4874-8d4c-40f40fbee184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:25:55 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f543edf7-1335-4964-8f89-963e85473334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:55 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f543edf7-1335-4964-8f89-963e85473334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1588717478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ee3f0ed-eed5-4bac-960d-3e922cc2746f,host='devstack@QuobyteHD#QuobyteHD',id=11c7fc70-abe7-4e03-9571-9c12d7771943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f855e1f6fe0482e8729d6d0d0f559d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:25:56Z,use_quota=True,user_id='d5f72ebf667c4c72bf94f8383eea025c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddd32b93-212b-4ab5-967e-561714abf937),volume_type_id=ddd32b93-212b-4ab5-967e-561714abf937)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:55 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055ef2d8-0f86-4691-b11b-005e245ea80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:55 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055ef2d8-0f86-4691-b11b-005e245ea80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:55 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b4e3db-be6e-4a0b-b19d-f8ca210d5395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:55 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b4e3db-be6e-4a0b-b19d-f8ca210d5395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11c7fc70-abe7-4e03-9571-9c12d7771943', 'volume_name': 'volume-11c7fc70-abe7-4e03-9571-9c12d7771943', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:55 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97164dd4-d1b9-4b9b-ac2a-f9de5f0eed78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:55 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97164dd4-d1b9-4b9b-ac2a-f9de5f0eed78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:55 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65e5476-1cdb-4e0e-a59d-4e4f411bd1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:55 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Volume 11c7fc70-abe7-4e03-9571-9c12d7771943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11c7fc70-abe7-4e03-9571-9c12d7771943', 'volume_size': 1} Sep 22 11:25:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2ee3f0ed-eed5-4bac-960d-3e922cc2746f,created_at=2025-09-22T09:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1588717478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ee3f0ed-eed5-4bac-960d-3e922cc2746f,host='devstack@QuobyteHD#QuobyteHD',id=11c7fc70-abe7-4e03-9571-9c12d7771943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f855e1f6fe0482e8729d6d0d0f559d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:25:56Z,use_quota=True,user_id='d5f72ebf667c4c72bf94f8383eea025c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddd32b93-212b-4ab5-967e-561714abf937),volume_type_id=ddd32b93-212b-4ab5-967e-561714abf937)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:25:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Creating volume 11c7fc70-abe7-4e03-9571-9c12d7771943 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:25:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:25:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:25:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:25:56 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:25:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:56 devstack quobyte-client[83313]: System call of process 95316 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:56 devstack quobyte-client[83313]: System call of process 95316 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:56 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=97, name=volume-11c7fc70-abe7-4e03-9571-9c12d7771943, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:25:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943 1073741824" returned: 0 in 0.733s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943" returned: 0 in 0.165s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] <== create_volume: return (1003ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:25:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65e5476-1cdb-4e0e-a59d-4e4f411bd1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11c7fc70-abe7-4e03-9571-9c12d7771943', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4cafdea-350d-46ef-9a21-bea41a9a467e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:25:57 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Volume volume-11c7fc70-abe7-4e03-9571-9c12d7771943 (11c7fc70-abe7-4e03-9571-9c12d7771943): created successfully Sep 22 11:25:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4cafdea-350d-46ef-9a21-bea41a9a467e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:25:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Flow 'volume_create_manager' (0ad7102e-3ca9-4874-8d4c-40f40fbee184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:25:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-56971319-05ff-416b-9cae-b18536b27420 req-9535ce46-5889-4365-a200-0bc38706fa6c tempest-TestInstancesWithCinderVolumes-450250349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:25:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-56971319-05ff-416b-9cae-b18536b27420 req-9535ce46-5889-4365-a200-0bc38706fa6c tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:25:57 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-f66dc909-e5a2-4d8f-a44b-b1468c7af6d4 tempest-GroupSnapshotsTest-527905842 None] Created volume successfully. Sep 22 11:25:57 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ad2838-82df-4627-b44d-2cb94870d57c]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:25:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-56971319-05ff-416b-9cae-b18536b27420 req-9535ce46-5889-4365-a200-0bc38706fa6c tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:58 devstack quobyte-client[83313]: System call of process 95332 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:58 devstack quobyte-client[83313]: System call of process 95332 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:25:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-56971319-05ff-416b-9cae-b18536b27420 req-9535ce46-5889-4365-a200-0bc38706fa6c tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996" returned: 0 in 0.788s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-56971319-05ff-416b-9cae-b18536b27420 req-9535ce46-5889-4365-a200-0bc38706fa6c tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:25:58 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-52ad2988-dd3d-4ebc-9646-593595ad3c1b tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:25:59 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-52ad2988-dd3d-4ebc-9646-593595ad3c1b tempest-GroupSnapshotsTest-527905842 None] Update group completed successfully. Sep 22 11:25:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-56971319-05ff-416b-9cae-b18536b27420 req-9535ce46-5889-4365-a200-0bc38706fa6c tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996" returned: 1 in 0.532s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:25:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-56971319-05ff-416b-9cae-b18536b27420 req-9535ce46-5889-4365-a200-0bc38706fa6c tempest-TestInstancesWithCinderVolumes-450250349 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:25:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-56971319-05ff-416b-9cae-b18536b27420 req-9535ce46-5889-4365-a200-0bc38706fa6c tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.449s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:25:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-56971319-05ff-416b-9cae-b18536b27420 req-9535ce46-5889-4365-a200-0bc38706fa6c tempest-TestInstancesWithCinderVolumes-450250349 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-920c9402-d08e-4926-aaf9-80358c9dd996', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3f32aa4-9a8d-4841-986e-ddb5f806cf27', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:25:59 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-56971319-05ff-416b-9cae-b18536b27420 req-9535ce46-5889-4365-a200-0bc38706fa6c tempest-TestInstancesWithCinderVolumes-450250349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:25:59 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-56971319-05ff-416b-9cae-b18536b27420 req-9535ce46-5889-4365-a200-0bc38706fa6c tempest-TestInstancesWithCinderVolumes-450250349 None] attachment_update completed successfully. Sep 22 11:25:59 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-fa097543-fe01-4cd0-a49f-585ea6be7976 tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:25:59 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-fa097543-fe01-4cd0-a49f-585ea6be7976 tempest-GroupSnapshotsTest-527905842 None] Update group completed successfully. Sep 22 11:26:00 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-c0a32ce1-7c9c-4f6b-9748-b409fa0981d3 tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:26:00 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-c0a32ce1-7c9c-4f6b-9748-b409fa0981d3 tempest-GroupSnapshotsTest-527905842 None] Update group completed successfully. Sep 22 11:26:01 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-e41b8447-4257-4dfe-9045-28df05139f80 tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:26:02 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-e41b8447-4257-4dfe-9045-28df05139f80 tempest-GroupSnapshotsTest-527905842 None] Update group completed successfully. Sep 22 11:26:03 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] GroupSnapshot a5a40e2f-192a-4fee-8ca0-b9752e64985c: creating. Sep 22 11:26:03 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:26:03 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Group snapshot a5a40e2f-192a-4fee-8ca0-b9752e64985c: creating. {{(pid=83310) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 22 11:26:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:26:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:26:03 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Creating offline snapshot 63837ea6-d85e-4311-8e06-80751ebd60a5 of volume c502307f-2fc3-413f-8fc4-f0fabe41f8b0 {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:26:03 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[fece37f0-6c13-41a7-92c5-8707efbf388d]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:26:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:03 devstack quobyte-client[83313]: System call of process 95407 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0" returned: 0 in 0.429s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.63837ea6-d85e-4311-8e06-80751ebd60a5 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:04 devstack quobyte-client[83313]: System call of process 95410 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:04 devstack quobyte-client[83313]: System call of process 95410 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:04 devstack quobyte-client[83313]: System call of process 95410 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:04 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=98, name=volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.63837ea6-d85e-4311-8e06-80751ebd60a5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:26:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.63837ea6-d85e-4311-8e06-80751ebd60a5 1G" returned: 0 in 0.269s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.63837ea6-d85e-4311-8e06-80751ebd60a5 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] CMD "qemu-img rebase -u -b volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.63837ea6-d85e-4311-8e06-80751ebd60a5" returned: 0 in 0.148s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.63837ea6-d85e-4311-8e06-80751ebd60a5 is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:26:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.63837ea6-d85e-4311-8e06-80751ebd60a5 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.63837ea6-d85e-4311-8e06-80751ebd60a5" returned: 0 in 0.113s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0 -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:26:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.63837ea6-d85e-4311-8e06-80751ebd60a5 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.63837ea6-d85e-4311-8e06-80751ebd60a5" returned: 0 in 0.173s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.info" returned: 0 in 0.132s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:05 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:26:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.info" returned: 0 in 0.107s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.707s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:26:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:26:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:26:05 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Creating offline snapshot a9229269-b8ec-480e-90e5-9fff092ee856 of volume 11c7fc70-abe7-4e03-9571-9c12d7771943 {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:26:05 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea580bc-cf9b-44b0-8166-c0f00afc0568]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:26:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:05 devstack quobyte-client[83313]: System call of process 95738 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:05 devstack quobyte-client[83313]: System call of process 95738 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:05 devstack quobyte-client[83313]: System call of process 95738 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943" returned: 0 in 0.565s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.a9229269-b8ec-480e-90e5-9fff092ee856 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:06 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=100, name=volume-11c7fc70-abe7-4e03-9571-9c12d7771943.a9229269-b8ec-480e-90e5-9fff092ee856, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:26:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.a9229269-b8ec-480e-90e5-9fff092ee856 1G" returned: 0 in 0.274s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): qemu-img rebase -u -b volume-11c7fc70-abe7-4e03-9571-9c12d7771943 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.a9229269-b8ec-480e-90e5-9fff092ee856 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] CMD "qemu-img rebase -u -b volume-11c7fc70-abe7-4e03-9571-9c12d7771943 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.a9229269-b8ec-480e-90e5-9fff092ee856" returned: 0 in 0.207s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:06 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.a9229269-b8ec-480e-90e5-9fff092ee856 is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:26:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.a9229269-b8ec-480e-90e5-9fff092ee856 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.a9229269-b8ec-480e-90e5-9fff092ee856" returned: 0 in 0.252s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:06 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943 -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:26:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.a9229269-b8ec-480e-90e5-9fff092ee856 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.a9229269-b8ec-480e-90e5-9fff092ee856" returned: 0 in 0.116s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.info" returned: 0 in 0.147s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:07 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:26:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.info" returned: 0 in 0.126s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:26:09 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=69,cinder:UPDATE=56,cinder:DELETE=3,cinder:INSERT=14 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:26:09 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=69,cinder:UPDATE=52,cinder:DELETE=3,cinder:INSERT=9 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:26:09 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-3c57660d-1ee5-45ed-be80-4a35215d201e tempest-GroupSnapshotsTest-527905842 None] group_snapshot a5a40e2f-192a-4fee-8ca0-b9752e64985c: created successfully Sep 22 11:26:10 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] group_snapshot a5a40e2f-192a-4fee-8ca0-b9752e64985c: deleting Sep 22 11:26:10 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:26:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] group_snapshot a5a40e2f-192a-4fee-8ca0-b9752e64985c: deleting {{(pid=83310) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 22 11:26:10 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "cinder-quobyte-c502307f-2fc3-413f-8fc4-f0fabe41f8b0" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:26:10 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-c502307f-2fc3-413f-8fc4-f0fabe41f8b0" acquired by "delete_snapshot" :: waited 0.069s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:26:10 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "cinder-quobyte-63837ea6-d85e-4311-8e06-80751ebd60a5" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:26:10 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-63837ea6-d85e-4311-8e06-80751ebd60a5" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:26:10 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Deleting offline snapshot 63837ea6-d85e-4311-8e06-80751ebd60a5 of volume c502307f-2fc3-413f-8fc4-f0fabe41f8b0 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:26:10 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] snapshot_file for this snap is: volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.63837ea6-d85e-4311-8e06-80751ebd60a5 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:26:10 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc6e094-c001-4919-b4b2-c0eaf9e7fe8f]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:26:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.63837ea6-d85e-4311-8e06-80751ebd60a5 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:11 devstack quobyte-client[83313]: System call of process 95808 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.63837ea6-d85e-4311-8e06-80751ebd60a5" returned: 0 in 0.753s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:11 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:26:11 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[db56ad3d-e1d6-4a6a-abea-a1ac7c9fa587]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:26:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0" returned: 0 in 0.685s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.63837ea6-d85e-4311-8e06-80751ebd60a5 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.63837ea6-d85e-4311-8e06-80751ebd60a5" returned: 0 in 0.392s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.63837ea6-d85e-4311-8e06-80751ebd60a5 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0.63837ea6-d85e-4311-8e06-80751ebd60a5" returned: 0 in 0.213s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:13 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-63837ea6-d85e-4311-8e06-80751ebd60a5" released by "_delete_snapshot" :: held 2.698s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:26:13 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-c502307f-2fc3-413f-8fc4-f0fabe41f8b0" released by "delete_snapshot" :: held 2.754s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:26:13 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "cinder-quobyte-11c7fc70-abe7-4e03-9571-9c12d7771943" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:26:13 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-11c7fc70-abe7-4e03-9571-9c12d7771943" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:26:13 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "cinder-quobyte-a9229269-b8ec-480e-90e5-9fff092ee856" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:26:13 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-a9229269-b8ec-480e-90e5-9fff092ee856" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:26:13 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Deleting offline snapshot a9229269-b8ec-480e-90e5-9fff092ee856 of volume 11c7fc70-abe7-4e03-9571-9c12d7771943 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:26:13 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] snapshot_file for this snap is: volume-11c7fc70-abe7-4e03-9571-9c12d7771943.a9229269-b8ec-480e-90e5-9fff092ee856 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:26:13 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2647e857-194b-4fa5-8593-ce034cb9bfe4]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:26:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.a9229269-b8ec-480e-90e5-9fff092ee856 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:13 devstack quobyte-client[83313]: System call of process 95833 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.a9229269-b8ec-480e-90e5-9fff092ee856" returned: 0 in 0.458s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:13 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11c7fc70-abe7-4e03-9571-9c12d7771943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:26:14 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b6bda7-c11e-4fef-beb0-d623088e3235]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:26:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943" returned: 0 in 0.527s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.a9229269-b8ec-480e-90e5-9fff092ee856 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.a9229269-b8ec-480e-90e5-9fff092ee856" returned: 0 in 0.243s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.a9229269-b8ec-480e-90e5-9fff092ee856 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943.a9229269-b8ec-480e-90e5-9fff092ee856" returned: 0 in 0.107s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-a9229269-b8ec-480e-90e5-9fff092ee856" released by "_delete_snapshot" :: held 1.863s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:26:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-11c7fc70-abe7-4e03-9571-9c12d7771943" released by "delete_snapshot" :: held 1.904s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:26:15 devstack cinder-volume[83310]: WARNING cinder.quota [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1432161887 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1432161887, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:26:15 devstack cinder-volume[83310]: WARNING cinder.quota [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1432161887 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1432161887, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:26:15 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Created reservations ['2e761db3-b3b6-4b0b-a021-8c04f888100e', '63bc30c8-b32a-460c-ab36-cea8ff9a2f30', 'eee076a8-97ec-45cf-be1c-d3a3e7b21117', '22ac9a7c-542e-4789-ae93-8f6d3d196653'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:26:16 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] Created reservations ['49ba7549-4de4-42ae-a43e-9fbdc471b8dc', 'd59efacb-fcef-4eda-85e7-33c00aa0dfa6', '0976a639-4d54-4703-b8a6-29d564b0743d', '7494b352-234a-4a3f-83c8-a266149ce3b7'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:26:16 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-d149e092-1879-4c4a-ab56-721bb156b6ca tempest-GroupSnapshotsTest-527905842 None] group_snapshot a5a40e2f-192a-4fee-8ca0-b9752e64985c: deleted successfully Sep 22 11:26:16 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:26:16 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "cinder-quobyte-11c7fc70-abe7-4e03-9571-9c12d7771943" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:26:16 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-11c7fc70-abe7-4e03-9571-9c12d7771943" acquired by "delete_volume" :: waited 0.027s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:26:17 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[650d534d-15ca-42d9-a70c-95fdab7b78ea]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:26:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:17 devstack quobyte-client[83313]: System call of process 95844 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:17 devstack quobyte-client[83313]: System call of process 95844 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:26:17 devstack quobyte-client[83313]: System call of process 95844 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:26:17 devstack quobyte-client[83313]: System call of process 95844 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:26:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:26:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:26:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:26:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943" returned: 0 in 0.767s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-11c7fc70-abe7-4e03-9571-9c12d7771943" returned: 0 in 0.212s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.518s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:18 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:26:18 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-11c7fc70-abe7-4e03-9571-9c12d7771943" released by "delete_volume" :: held 1.325s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:26:18 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "cinder-quobyte-c502307f-2fc3-413f-8fc4-f0fabe41f8b0" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:26:18 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-c502307f-2fc3-413f-8fc4-f0fabe41f8b0" acquired by "delete_volume" :: waited 0.087s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:26:18 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa17b97-469e-4f14-82ca-87f70f3037ed]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:26:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0" returned: 0 in 0.613s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c502307f-2fc3-413f-8fc4-f0fabe41f8b0" returned: 0 in 0.216s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:19 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-c502307f-2fc3-413f-8fc4-f0fabe41f8b0" released by "delete_volume" :: held 1.283s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:26:20 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Created reservations ['db0e3498-d185-4384-84b5-74cb6302e8a8'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:26:20 devstack cinder-volume[83310]: WARNING cinder.quota [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1432161887 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1432161887, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:26:20 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Created reservations ['f101bbf7-1a16-4973-993c-bb20d27b4440', '654f343b-f540-4a06-b5d2-a15d0f975018', 'dd52d5fa-64e3-4b0c-a5b1-bcb911b75741', '381b5d75-3ddc-4ed7-8037-63099ed87b14'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:26:20 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Created reservations ['de062948-5b7e-4604-95e8-8dfc3540dd2d', '3253bf7a-2cdf-4cd7-8dd8-0243ba6d8026', '1312041f-39e3-458c-ab64-636afd1eff93', '34212d8d-0cba-4608-b54f-f31bed8f5cc2'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:26:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:26:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:26:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:26:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:26:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:26:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.270s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:21 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:26:22 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-1c9486db-2c6a-4d6e-a664-9cb55e00910e tempest-GroupSnapshotsTest-527905842 None] Delete group completed successfully. Sep 22 11:26:23 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-93921adc-ca8f-4e80-b9b7-0842b213a14a tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:26:23 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-93921adc-ca8f-4e80-b9b7-0842b213a14a tempest-GroupSnapshotsTest-527905842 None] Group tempest-GroupSnapshotsTest-Group-182274257: creating Sep 22 11:26:23 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-93921adc-ca8f-4e80-b9b7-0842b213a14a tempest-GroupSnapshotsTest-527905842 None] Group tempest-GroupSnapshotsTest-Group-182274257: created successfully Sep 22 11:26:23 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-93921adc-ca8f-4e80-b9b7-0842b213a14a tempest-GroupSnapshotsTest-527905842 None] Create group completed successfully. Sep 22 11:26:25 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Flow 'volume_create_manager' (03ba4613-6300-4a7d-89cf-fa8a131cc1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02868808-b8bf-458f-824b-987809910cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02868808-b8bf-458f-824b-987809910cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1421421124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73f22fd6-b6e8-498a-959b-a8cf08714f5b,host='devstack@QuobyteHD#QuobyteHD',id=f4f86453-9fef-4d0e-80fb-a83ae0af88ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f855e1f6fe0482e8729d6d0d0f559d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:26:25Z,use_quota=True,user_id='d5f72ebf667c4c72bf94f8383eea025c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b86730d6-da0f-4ddc-9a47-f8aba485725c),volume_type_id=b86730d6-da0f-4ddc-9a47-f8aba485725c)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896e13d3-41fb-4bf9-be2b-a053c312e0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896e13d3-41fb-4bf9-be2b-a053c312e0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd87831-cd3b-49d6-bb4a-3c5cd9166ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd87831-cd3b-49d6-bb4a-3c5cd9166ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4f86453-9fef-4d0e-80fb-a83ae0af88ed', 'volume_name': 'volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4016efd-fb42-48ea-8fe1-1fe9c551ca8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4016efd-fb42-48ea-8fe1-1fe9c551ca8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94afa722-4140-44a2-8f4c-fe811ad979a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:26:25 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Volume f4f86453-9fef-4d0e-80fb-a83ae0af88ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed', 'volume_size': 1} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=73f22fd6-b6e8-498a-959b-a8cf08714f5b,created_at=2025-09-22T09:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1421421124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73f22fd6-b6e8-498a-959b-a8cf08714f5b,host='devstack@QuobyteHD#QuobyteHD',id=f4f86453-9fef-4d0e-80fb-a83ae0af88ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f855e1f6fe0482e8729d6d0d0f559d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:26:25Z,use_quota=True,user_id='d5f72ebf667c4c72bf94f8383eea025c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b86730d6-da0f-4ddc-9a47-f8aba485725c),volume_type_id=b86730d6-da0f-4ddc-9a47-f8aba485725c)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Creating volume f4f86453-9fef-4d0e-80fb-a83ae0af88ed {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:26:25 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:26:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:25 devstack quobyte-client[83313]: System call of process 95881 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:25 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=102, name=volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:26:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed 1073741824" returned: 0 in 0.615s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed" returned: 0 in 0.148s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] <== create_volume: return (873ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:26:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:26:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94afa722-4140-44a2-8f4c-fe811ad979a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:26:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75be5d9-20d3-490e-ad03-d3636bb49ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:26:26 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Volume volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed (f4f86453-9fef-4d0e-80fb-a83ae0af88ed): created successfully Sep 22 11:26:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75be5d9-20d3-490e-ad03-d3636bb49ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:26:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Flow 'volume_create_manager' (03ba4613-6300-4a7d-89cf-fa8a131cc1fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:26:26 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-f422898c-b01d-406d-85cd-783a0ac72265 tempest-GroupSnapshotsTest-527905842 None] Created volume successfully. Sep 22 11:26:27 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] GroupSnapshot 5bfc9634-3498-492a-aba6-87acfeb20cf4: creating. Sep 22 11:26:27 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:26:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] Group snapshot 5bfc9634-3498-492a-aba6-87acfeb20cf4: creating. {{(pid=83310) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 22 11:26:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:26:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:26:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] Creating offline snapshot ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da of volume f4f86453-9fef-4d0e-80fb-a83ae0af88ed {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:26:27 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba3327b-528a-48a2-868b-7b881b9cca37]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:26:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed" returned: 0 in 0.630s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:28 devstack quobyte-client[83313]: System call of process 95892 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:28 devstack quobyte-client[83313]: System call of process 95892 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:28 devstack quobyte-client[83313]: System call of process 95892 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:28 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=103, name=volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:26:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da 1G" returned: 0 in 0.334s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:29 devstack quobyte-client[83313]: System call of process 95895 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] CMD "qemu-img rebase -u -b volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da" returned: 0 in 0.279s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:26:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da" returned: 0 in 0.233s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:26:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da" returned: 0 in 0.249s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.info" returned: 0 in 0.137s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:30 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:26:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.info" returned: 0 in 0.169s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.586s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:26:30 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-65da8566-113d-4922-b81d-8988da5aee0f tempest-GroupSnapshotsTest-527905842 None] group_snapshot 5bfc9634-3498-492a-aba6-87acfeb20cf4: created successfully Sep 22 11:26:31 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] group_snapshot 5bfc9634-3498-492a-aba6-87acfeb20cf4: deleting Sep 22 11:26:31 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:26:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] group_snapshot 5bfc9634-3498-492a-aba6-87acfeb20cf4: deleting {{(pid=83310) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 22 11:26:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "cinder-quobyte-f4f86453-9fef-4d0e-80fb-a83ae0af88ed" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:26:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-f4f86453-9fef-4d0e-80fb-a83ae0af88ed" acquired by "delete_snapshot" :: waited 0.089s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:26:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "cinder-quobyte-ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:26:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:26:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] Deleting offline snapshot ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da of volume f4f86453-9fef-4d0e-80fb-a83ae0af88ed {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:26:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] snapshot_file for this snap is: volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:26:31 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4465e4c7-dafd-473a-b97e-ef27a3456e34]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:26:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da" returned: 0 in 0.484s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:32 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:26:32 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e93d04b-67e6-491a-8e70-a4f34687553c]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:26:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:32 devstack quobyte-client[83313]: System call of process 95905 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed" returned: 0 in 0.534s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da" returned: 0 in 0.243s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed.ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da" returned: 0 in 0.108s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:33 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-ee7fa0d1-db1c-4e36-8ed5-fe4dfbd203da" released by "_delete_snapshot" :: held 1.762s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:26:33 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-f4f86453-9fef-4d0e-80fb-a83ae0af88ed" released by "delete_snapshot" :: held 1.790s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:26:33 devstack cinder-volume[83310]: WARNING cinder.quota [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1553894259 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1553894259, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:26:33 devstack cinder-volume[83310]: WARNING cinder.quota [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1553894259 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1553894259, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:26:33 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] Created reservations ['37401293-f4b3-431e-9d8f-06753321dfcc', '8c2161ce-b0eb-4759-8ca0-44517ddf524c', 'fecff8fe-f10c-4929-80a3-e70e59283934', '46d2988d-e9af-4e0a-a714-96099b8525cb'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:26:33 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-fcdc81f4-0f4c-420c-8637-e7021ead329d tempest-GroupSnapshotsTest-527905842 None] group_snapshot 5bfc9634-3498-492a-aba6-87acfeb20cf4: deleted successfully Sep 22 11:26:35 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:26:35 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "cinder-quobyte-f4f86453-9fef-4d0e-80fb-a83ae0af88ed" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:26:35 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-f4f86453-9fef-4d0e-80fb-a83ae0af88ed" acquired by "delete_volume" :: waited 0.037s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:26:35 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4380658a-ef15-4bbf-bac0-36f063a63e39]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:26:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:36 devstack quobyte-client[83313]: System call of process 95914 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed" returned: 0 in 0.944s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f4f86453-9fef-4d0e-80fb-a83ae0af88ed" returned: 0 in 0.117s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:36 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] Lock "cinder-quobyte-f4f86453-9fef-4d0e-80fb-a83ae0af88ed" released by "delete_volume" :: held 1.523s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:26:37 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] Created reservations ['b53dc079-0b2f-42dd-be38-e948fd470a8f'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:26:37 devstack cinder-volume[83310]: WARNING cinder.quota [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1553894259 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1553894259, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:26:37 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] Created reservations ['dda38cd4-8501-4532-92a4-fc6381e171f0', '79cb03c3-d0af-4f75-a9db-01dc184b7316', 'ba533b88-20f6-4c00-8bff-7101bc579666', '29ba88ff-be82-4d21-849f-3b01d06af858'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:26:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:26:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:26:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:26:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:26:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:26:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.148s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:37 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:26:37 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-694a15b8-8af5-4a32-917c-3b986a43bc0b tempest-GroupSnapshotsTest-527905842 None] Delete group completed successfully. Sep 22 11:26:45 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-6450475c-a5df-41be-98ef-4beb3826e28b tempest-GroupSnapshotsV319Test-292651807 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:26:45 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-6450475c-a5df-41be-98ef-4beb3826e28b tempest-GroupSnapshotsV319Test-292651807 None] Group tempest-GroupSnapshotsV319Test-Group-180348909: creating Sep 22 11:26:45 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-6450475c-a5df-41be-98ef-4beb3826e28b tempest-GroupSnapshotsV319Test-292651807 None] Group tempest-GroupSnapshotsV319Test-Group-180348909: created successfully Sep 22 11:26:45 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-6450475c-a5df-41be-98ef-4beb3826e28b tempest-GroupSnapshotsV319Test-292651807 None] Create group completed successfully. Sep 22 11:26:47 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Flow 'volume_create_manager' (2345fbfa-e2b2-4157-83e7-f6d8f0282997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c4e13d-8aaa-4fb5-9c67-03d16eff1256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c4e13d-8aaa-4fb5-9c67-03d16eff1256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-223895800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ab01fc1-0530-4242-906f-86e6bbdf80c8,host='devstack@QuobyteHD#QuobyteHD',id=5f76bb32-e52e-4ee1-bbe2-48b9a8873378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e3d95d62404f8684e70de4e009dc33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:26:47Z,use_quota=True,user_id='525cb151da2a451292e32c781ff52ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f41dfa5-7c14-4613-94d4-30249e08b0b4),volume_type_id=5f41dfa5-7c14-4613-94d4-30249e08b0b4)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b3e8ce-bb89-44f1-9d43-5d3dd796fddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b3e8ce-bb89-44f1-9d43-5d3dd796fddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4c3729-f436-44bd-ac09-2c2b49321dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4c3729-f436-44bd-ac09-2c2b49321dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f76bb32-e52e-4ee1-bbe2-48b9a8873378', 'volume_name': 'volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca07379-7d20-4518-8ea5-1955838f93db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca07379-7d20-4518-8ea5-1955838f93db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524def3a-580b-4873-88a7-5009f9f16b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:26:47 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Volume 5f76bb32-e52e-4ee1-bbe2-48b9a8873378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378', 'volume_size': 1} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3ab01fc1-0530-4242-906f-86e6bbdf80c8,created_at=2025-09-22T09:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-223895800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ab01fc1-0530-4242-906f-86e6bbdf80c8,host='devstack@QuobyteHD#QuobyteHD',id=5f76bb32-e52e-4ee1-bbe2-48b9a8873378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95e3d95d62404f8684e70de4e009dc33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:26:47Z,use_quota=True,user_id='525cb151da2a451292e32c781ff52ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f41dfa5-7c14-4613-94d4-30249e08b0b4),volume_type_id=5f41dfa5-7c14-4613-94d4-30249e08b0b4)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Creating volume 5f76bb32-e52e-4ee1-bbe2-48b9a8873378 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:26:47 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:47 devstack quobyte-client[83313]: System call of process 95954 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:47 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=105, name=volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378 1073741824" returned: 0 in 0.512s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378" returned: 0 in 0.143s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] <== create_volume: return (721ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:26:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:26:48 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524def3a-580b-4873-88a7-5009f9f16b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:26:48 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c1261f-9111-4c26-aedb-458bef9deea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:26:48 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Volume volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378 (5f76bb32-e52e-4ee1-bbe2-48b9a8873378): created successfully Sep 22 11:26:48 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c1261f-9111-4c26-aedb-458bef9deea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:26:48 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Flow 'volume_create_manager' (2345fbfa-e2b2-4157-83e7-f6d8f0282997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:26:48 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-5bb8798b-33c0-45a3-b34d-f11117ebc660 tempest-GroupSnapshotsV319Test-292651807 None] Created volume successfully. Sep 22 11:26:49 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] GroupSnapshot d89dad6d-b9b1-45fd-afa7-a521d1fa4935: creating. Sep 22 11:26:49 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:26:49 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] Group snapshot d89dad6d-b9b1-45fd-afa7-a521d1fa4935: creating. {{(pid=83310) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 22 11:26:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:26:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:26:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] Creating offline snapshot 8b4c7e90-9516-4032-be47-325c60d3c3a3 of volume 5f76bb32-e52e-4ee1-bbe2-48b9a8873378 {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:26:49 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[83693b3f-e686-446b-bc84-9979a71ae3c6]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:26:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378" returned: 0 in 0.485s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.8b4c7e90-9516-4032-be47-325c60d3c3a3 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:50 devstack quobyte-client[83313]: System call of process 95975 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:50 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=106, name=volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.8b4c7e90-9516-4032-be47-325c60d3c3a3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:26:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.8b4c7e90-9516-4032-be47-325c60d3c3a3 1G" returned: 0 in 0.266s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.8b4c7e90-9516-4032-be47-325c60d3c3a3 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] CMD "qemu-img rebase -u -b volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.8b4c7e90-9516-4032-be47-325c60d3c3a3" returned: 0 in 0.180s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:50 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.8b4c7e90-9516-4032-be47-325c60d3c3a3 is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:26:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.8b4c7e90-9516-4032-be47-325c60d3c3a3 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.8b4c7e90-9516-4032-be47-325c60d3c3a3" returned: 0 in 0.107s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378 -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:26:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.8b4c7e90-9516-4032-be47-325c60d3c3a3 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.8b4c7e90-9516-4032-be47-325c60d3c3a3" returned: 0 in 0.111s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.info" returned: 0 in 0.108s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:26:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.info" returned: 0 in 0.102s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.763s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:26:51 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-30de7564-99ec-4212-8be6-a29ae70a5e3f tempest-GroupSnapshotsV319Test-292651807 None] group_snapshot d89dad6d-b9b1-45fd-afa7-a521d1fa4935: created successfully Sep 22 11:26:53 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] group_snapshot d89dad6d-b9b1-45fd-afa7-a521d1fa4935: deleting Sep 22 11:26:53 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:26:53 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] group_snapshot d89dad6d-b9b1-45fd-afa7-a521d1fa4935: deleting {{(pid=83310) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 22 11:26:53 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] Acquiring lock "cinder-quobyte-5f76bb32-e52e-4ee1-bbe2-48b9a8873378" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:26:53 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] Lock "cinder-quobyte-5f76bb32-e52e-4ee1-bbe2-48b9a8873378" acquired by "delete_snapshot" :: waited 0.041s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:26:53 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] Acquiring lock "cinder-quobyte-8b4c7e90-9516-4032-be47-325c60d3c3a3" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:26:53 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] Lock "cinder-quobyte-8b4c7e90-9516-4032-be47-325c60d3c3a3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:26:53 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] Deleting offline snapshot 8b4c7e90-9516-4032-be47-325c60d3c3a3 of volume 5f76bb32-e52e-4ee1-bbe2-48b9a8873378 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:26:53 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] snapshot_file for this snap is: volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.8b4c7e90-9516-4032-be47-325c60d3c3a3 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:26:53 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ffb80a-3998-4834-b134-9fbd4d52fed7]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:26:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.8b4c7e90-9516-4032-be47-325c60d3c3a3 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:54 devstack quobyte-client[83313]: System call of process 95985 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:54 devstack quobyte-client[83313]: System call of process 95985 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:26:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.8b4c7e90-9516-4032-be47-325c60d3c3a3" returned: 0 in 0.488s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:26:54 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[87936283-1474-493b-9ace-740099c9731f]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:26:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378" returned: 0 in 0.527s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.8b4c7e90-9516-4032-be47-325c60d3c3a3 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.8b4c7e90-9516-4032-be47-325c60d3c3a3" returned: 0 in 0.253s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.8b4c7e90-9516-4032-be47-325c60d3c3a3 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378.8b4c7e90-9516-4032-be47-325c60d3c3a3" returned: 0 in 0.117s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] Lock "cinder-quobyte-8b4c7e90-9516-4032-be47-325c60d3c3a3" released by "_delete_snapshot" :: held 1.816s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:26:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] Lock "cinder-quobyte-5f76bb32-e52e-4ee1-bbe2-48b9a8873378" released by "delete_snapshot" :: held 1.857s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:26:55 devstack cinder-volume[83310]: WARNING cinder.quota [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-78478538 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-78478538, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:26:55 devstack cinder-volume[83310]: WARNING cinder.quota [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-78478538 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-78478538, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:26:55 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] Created reservations ['f16be57b-e9aa-4ccc-a1c1-05bba061ae62', '4ea98264-d6c8-4d56-86a9-6b7b03c59a20', 'aaf4998f-0463-4bb0-bb68-d07d77a5819c', 'ba5b08e2-aae0-4859-95b7-a7f86c38e057'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:26:56 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-548b6a35-f935-421e-9686-645edcffe5f1 tempest-GroupSnapshotsV319Test-292651807 None] group_snapshot d89dad6d-b9b1-45fd-afa7-a521d1fa4935: deleted successfully Sep 22 11:26:57 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:26:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] Acquiring lock "cinder-quobyte-5f76bb32-e52e-4ee1-bbe2-48b9a8873378" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:26:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] Lock "cinder-quobyte-5f76bb32-e52e-4ee1-bbe2-48b9a8873378" acquired by "delete_volume" :: waited 0.035s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:26:57 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2f6291-c40a-465c-afdf-fc09c1a8ee88]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:26:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378" returned: 0 in 0.522s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5f76bb32-e52e-4ee1-bbe2-48b9a8873378" returned: 0 in 0.103s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] Lock "cinder-quobyte-5f76bb32-e52e-4ee1-bbe2-48b9a8873378" released by "delete_volume" :: held 0.840s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:26:58 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] Created reservations ['b9a8f945-0415-4de5-983e-c31b2e1cd6e0'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:26:58 devstack cinder-volume[83310]: WARNING cinder.quota [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-78478538 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-78478538, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:26:58 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] Created reservations ['bf40fa57-9b51-4c92-8ec7-4b3f85e9be5f', '6e17263c-e826-4682-aace-c4c0678beee1', '3f118eb8-0e68-4532-b26c-adfcaa015637', '107c5fd3-2d94-4f57-a86a-2724c233265e'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:26:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:26:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:26:58 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:26:58 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:26:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:26:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:26:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.092s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:26:58 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:26:59 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-3acf6c2a-0e4f-44de-bae0-b27dccec448b tempest-GroupSnapshotsV319Test-292651807 None] Delete group completed successfully. Sep 22 11:27:08 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=76,cinder:UPDATE=65,cinder:INSERT=16 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:27:08 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=85,cinder:SELECT=71,cinder:INSERT=19,cinder:DELETE=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:27:12 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Flow 'volume_create_manager' (c3783036-4830-416d-9108-c6d054e021c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5b22b0-555e-4ea3-adda-ec2d6c7f89f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5b22b0-555e-4ea3-adda-ec2d6c7f89f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1330511350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f939da-3a89-420b-8538-6304bd86ff99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a4d84d468c45288c34c9cdc6930574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:27:12Z,use_quota=True,user_id='7c0f70b3002b4cdbac145ac244d2c411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f92f28-8801-40cd-b11e-eed551eb726b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f92f28-8801-40cd-b11e-eed551eb726b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f086ac36-8b17-4597-bbe9-790064adec11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f086ac36-8b17-4597-bbe9-790064adec11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5f939da-3a89-420b-8538-6304bd86ff99', 'volume_name': 'volume-b5f939da-3a89-420b-8538-6304bd86ff99', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29158696-4baf-4808-b115-1b1e82a6d963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29158696-4baf-4808-b115-1b1e82a6d963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca59fe61-5529-4135-8556-ca8a21d7135f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:27:12 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Volume b5f939da-3a89-420b-8538-6304bd86ff99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5f939da-3a89-420b-8538-6304bd86ff99', 'volume_size': 1} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1330511350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f939da-3a89-420b-8538-6304bd86ff99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a4d84d468c45288c34c9cdc6930574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:27:12Z,use_quota=True,user_id='7c0f70b3002b4cdbac145ac244d2c411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Creating volume b5f939da-3a89-420b-8538-6304bd86ff99 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:27:12 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:27:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b5f939da-3a89-420b-8538-6304bd86ff99 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:12 devstack quobyte-client[83313]: System call of process 96023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:27:12 devstack quobyte-client[83313]: System call of process 96023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:27:12 devstack quobyte-client[83313]: System call of process 96023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:27:12 devstack quobyte-client[83313]: System call of process 96023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:27:12 devstack quobyte-client[83313]: System call of process 96023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:27:12 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=108, name=volume-b5f939da-3a89-420b-8538-6304bd86ff99, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:27:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b5f939da-3a89-420b-8538-6304bd86ff99 1073741824" returned: 0 in 0.462s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b5f939da-3a89-420b-8538-6304bd86ff99 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b5f939da-3a89-420b-8538-6304bd86ff99" returned: 0 in 0.165s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:13 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] <== create_volume: return (719ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:27:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:27:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca59fe61-5529-4135-8556-ca8a21d7135f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5f939da-3a89-420b-8538-6304bd86ff99', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:27:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb016799-aebb-4132-8175-7f3d44e632ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:27:13 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Volume volume-b5f939da-3a89-420b-8538-6304bd86ff99 (b5f939da-3a89-420b-8538-6304bd86ff99): created successfully Sep 22 11:27:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb016799-aebb-4132-8175-7f3d44e632ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:27:13 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Flow 'volume_create_manager' (c3783036-4830-416d-9108-c6d054e021c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:27:13 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-6b641adc-948f-47c1-b106-f28abee5e221 tempest-VolumesServicesTestJSON-332509674 None] Created volume successfully. Sep 22 11:27:14 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] Acquiring lock "cinder-b5f939da-3a89-420b-8538-6304bd86ff99-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:27:14 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] Lock "cinder-b5f939da-3a89-420b-8538-6304bd86ff99-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:27:14 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:27:14 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] Acquiring lock "cinder-quobyte-b5f939da-3a89-420b-8538-6304bd86ff99" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:27:14 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] Lock "cinder-quobyte-b5f939da-3a89-420b-8538-6304bd86ff99" acquired by "delete_volume" :: waited 0.011s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:27:14 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e762e540-a466-4bfe-b5d0-7a44832ad894]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:27:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b5f939da-3a89-420b-8538-6304bd86ff99 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:15 devstack quobyte-client[83313]: System call of process 96030 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:27:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b5f939da-3a89-420b-8538-6304bd86ff99" returned: 0 in 0.494s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b5f939da-3a89-420b-8538-6304bd86ff99 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b5f939da-3a89-420b-8538-6304bd86ff99" returned: 0 in 0.128s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] Lock "cinder-quobyte-b5f939da-3a89-420b-8538-6304bd86ff99" released by "delete_volume" :: held 0.821s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:27:16 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] Created reservations ['1a5a3bd2-0c22-4cd3-a986-62c60a2f468d', '061fab77-c364-4935-a7dd-20b1a61443e2', '3e84d180-5cf8-4a45-9239-b98077e00d67', 'e20592bc-0f4d-452e-b3cc-584c00edb621'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:27:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:27:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:27:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:27:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:27:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:27:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.099s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:16 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:27:16 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] Deleted volume successfully. Sep 22 11:27:16 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f4e55c6f-4a92-4eb2-84e9-e082a2f324d1 tempest-VolumesServicesTestJSON-332509674 None] Lock "cinder-b5f939da-3a89-420b-8538-6304bd86ff99-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:27:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:27:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:27:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:27:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:27:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:27:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:27:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.169s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:27:26 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=7,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:27:26 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=7,cinder:DELETE=2,cinder:SELECT=5,cinder:INSERT=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:27:28 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Flow 'volume_create_manager' (bf3af107-9cc4-4ce9-932f-b2a02159a34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3d2601-fa41-4de6-8f6a-e35472c0184e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3d2601-fa41-4de6-8f6a-e35472c0184e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1823736372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97cc899a-7f0e-4bc1-9683-2a6fe1e70855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661d5fd9dfd34c5985877e62deb010f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:27:28Z,use_quota=True,user_id='c6670632b78e49a0863b2c927f870ba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2c3378-055b-4474-b8ec-e9b0f8eec721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2c3378-055b-4474-b8ec-e9b0f8eec721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545fe1db-8763-401f-a2e9-471aa4740f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545fe1db-8763-401f-a2e9-471aa4740f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97cc899a-7f0e-4bc1-9683-2a6fe1e70855', 'volume_name': 'volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcafe026-80a0-47af-a38f-23a443726bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcafe026-80a0-47af-a38f-23a443726bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893258ea-ddb9-442f-9cc1-b8d64425a4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:27:28 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Volume 97cc899a-7f0e-4bc1-9683-2a6fe1e70855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855', 'volume_size': 1} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1823736372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97cc899a-7f0e-4bc1-9683-2a6fe1e70855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661d5fd9dfd34c5985877e62deb010f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:27:28Z,use_quota=True,user_id='c6670632b78e49a0863b2c927f870ba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Creating volume 97cc899a-7f0e-4bc1-9683-2a6fe1e70855 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:27:28 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:27:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:28 devstack quobyte-client[83313]: System call of process 96041 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:27:28 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=109, name=volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:27:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855 1073741824" returned: 0 in 0.395s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855" returned: 0 in 0.086s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] <== create_volume: return (550ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:27:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.563s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:27:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893258ea-ddb9-442f-9cc1-b8d64425a4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:27:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09311777-0c33-4346-a0c4-eadc7671ee43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:27:29 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Volume volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855 (97cc899a-7f0e-4bc1-9683-2a6fe1e70855): created successfully Sep 22 11:27:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09311777-0c33-4346-a0c4-eadc7671ee43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:27:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Flow 'volume_create_manager' (bf3af107-9cc4-4ce9-932f-b2a02159a34d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:27:29 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-193721ab-0e8d-479f-927d-b58e01e0ba1c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Created volume successfully. Sep 22 11:27:30 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:27:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:27:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:27:30 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Creating offline snapshot 3fafaf95-e07b-4308-84b6-3bce575c6dd7 of volume 97cc899a-7f0e-4bc1-9683-2a6fe1e70855 {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:27:30 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2257b4-3217-4b8f-9aa4-a4f360c41378]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:27:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:31 devstack quobyte-client[83313]: System call of process 96045 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:27:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855" returned: 0 in 0.495s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.3fafaf95-e07b-4308-84b6-3bce575c6dd7 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:31 devstack quobyte-client[83313]: System call of process 96052 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:27:31 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=110, name=volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.3fafaf95-e07b-4308-84b6-3bce575c6dd7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:27:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.3fafaf95-e07b-4308-84b6-3bce575c6dd7 1G" returned: 0 in 0.326s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Running cmd (subprocess): qemu-img rebase -u -b volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.3fafaf95-e07b-4308-84b6-3bce575c6dd7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:31 devstack quobyte-client[83313]: System call of process 96055 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:27:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] CMD "qemu-img rebase -u -b volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.3fafaf95-e07b-4308-84b6-3bce575c6dd7" returned: 0 in 0.175s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.3fafaf95-e07b-4308-84b6-3bce575c6dd7 is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:27:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.3fafaf95-e07b-4308-84b6-3bce575c6dd7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.3fafaf95-e07b-4308-84b6-3bce575c6dd7" returned: 0 in 0.124s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:32 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855 -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:27:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.3fafaf95-e07b-4308-84b6-3bce575c6dd7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.3fafaf95-e07b-4308-84b6-3bce575c6dd7" returned: 0 in 0.116s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.info" returned: 0 in 0.096s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:32 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:27:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.info" returned: 0 in 0.083s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.764s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:27:32 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-329ae7a5-7a34-42c1-9be3-cd36f92349fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Create snapshot completed successfully Sep 22 11:27:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Acquiring lock "cinder-3fafaf95-e07b-4308-84b6-3bce575c6dd7-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:27:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Lock "cinder-3fafaf95-e07b-4308-84b6-3bce575c6dd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.092s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:27:34 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:27:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Acquiring lock "cinder-quobyte-97cc899a-7f0e-4bc1-9683-2a6fe1e70855" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:27:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Lock "cinder-quobyte-97cc899a-7f0e-4bc1-9683-2a6fe1e70855" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:27:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Acquiring lock "cinder-quobyte-3fafaf95-e07b-4308-84b6-3bce575c6dd7" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:27:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Lock "cinder-quobyte-3fafaf95-e07b-4308-84b6-3bce575c6dd7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:27:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Deleting offline snapshot 3fafaf95-e07b-4308-84b6-3bce575c6dd7 of volume 97cc899a-7f0e-4bc1-9683-2a6fe1e70855 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:27:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] snapshot_file for this snap is: volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.3fafaf95-e07b-4308-84b6-3bce575c6dd7 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:27:34 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[31227540-1384-45af-bd74-462bd075bdd4]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:27:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.3fafaf95-e07b-4308-84b6-3bce575c6dd7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.3fafaf95-e07b-4308-84b6-3bce575c6dd7" returned: 0 in 0.438s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:27:35 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[297e9864-d121-49ac-bee9-adab3b891113]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:27:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:35 devstack quobyte-client[83313]: System call of process 96068 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:27:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855" returned: 0 in 0.707s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.3fafaf95-e07b-4308-84b6-3bce575c6dd7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-7ca91638-51ec-46d6-9f2f-8c70c038943e req-3ca42c26-5dc9-474d-a9ab-2a140e3a4b37 tempest-TestInstancesWithCinderVolumes-450250349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:27:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-7ca91638-51ec-46d6-9f2f-8c70c038943e req-3ca42c26-5dc9-474d-a9ab-2a140e3a4b37 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:27:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.3fafaf95-e07b-4308-84b6-3bce575c6dd7" returned: 0 in 0.651s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.3fafaf95-e07b-4308-84b6-3bce575c6dd7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:36 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9255a9f-a6d6-44e3-ab5e-23b539eb022e]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:27:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-7ca91638-51ec-46d6-9f2f-8c70c038943e req-3ca42c26-5dc9-474d-a9ab-2a140e3a4b37 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ad1b2aa5-fa7a-4585-9173-283707840fa4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855.3fafaf95-e07b-4308-84b6-3bce575c6dd7" returned: 0 in 0.324s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:37 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Lock "cinder-quobyte-3fafaf95-e07b-4308-84b6-3bce575c6dd7" released by "_delete_snapshot" :: held 2.635s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:27:37 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Lock "cinder-quobyte-97cc899a-7f0e-4bc1-9683-2a6fe1e70855" released by "delete_snapshot" :: held 2.683s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:27:37 devstack quobyte-client[83313]: System call of process 96081 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:27:37 devstack quobyte-client[83313]: System call of process 96081 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:27:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-7ca91638-51ec-46d6-9f2f-8c70c038943e req-3ca42c26-5dc9-474d-a9ab-2a140e3a4b37 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ad1b2aa5-fa7a-4585-9173-283707840fa4" returned: 0 in 0.832s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-7ca91638-51ec-46d6-9f2f-8c70c038943e req-3ca42c26-5dc9-474d-a9ab-2a140e3a4b37 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:27:37 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Created reservations ['58767554-e74f-4457-aa4e-87ad969dae87', '96ac2b15-d74b-4107-a736-f60ae75468cb', 'b4d95a5f-9e3c-4efb-85ce-4745dd3da3a7', 'a31e8817-0466-433a-bb37-3eb6292d8e4a'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:27:37 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-7ca91638-51ec-46d6-9f2f-8c70c038943e req-3ca42c26-5dc9-474d-a9ab-2a140e3a4b37 tempest-TestInstancesWithCinderVolumes-450250349 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-ad1b2aa5-fa7a-4585-9173-283707840fa4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2050d508-e03f-4a28-a23c-37a8c9ce38c0', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:27:37 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-7ca91638-51ec-46d6-9f2f-8c70c038943e req-3ca42c26-5dc9-474d-a9ab-2a140e3a4b37 tempest-TestInstancesWithCinderVolumes-450250349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:27:37 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Delete snapshot completed successfully. Sep 22 11:27:37 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6c223c44-0856-42eb-80c2-db405dcde510 tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Lock "cinder-3fafaf95-e07b-4308-84b6-3bce575c6dd7-delete_snapshot" released by "delete_snapshot" :: held 3.310s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:27:38 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-7ca91638-51ec-46d6-9f2f-8c70c038943e req-3ca42c26-5dc9-474d-a9ab-2a140e3a4b37 tempest-TestInstancesWithCinderVolumes-450250349 None] attachment_update completed successfully. Sep 22 11:27:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Acquiring lock "cinder-97cc899a-7f0e-4bc1-9683-2a6fe1e70855-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:27:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Lock "cinder-97cc899a-7f0e-4bc1-9683-2a6fe1e70855-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:27:39 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:27:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Acquiring lock "cinder-quobyte-97cc899a-7f0e-4bc1-9683-2a6fe1e70855" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:27:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Lock "cinder-quobyte-97cc899a-7f0e-4bc1-9683-2a6fe1e70855" acquired by "delete_volume" :: waited 0.015s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:27:39 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[235063eb-a05e-466e-afb3-5369ae5debe1]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:27:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:39 devstack quobyte-client[83313]: System call of process 96090 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:27:39 devstack quobyte-client[83313]: System call of process 96090 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:27:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855" returned: 0 in 0.561s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-97cc899a-7f0e-4bc1-9683-2a6fe1e70855" returned: 0 in 0.141s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:40 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Lock "cinder-quobyte-97cc899a-7f0e-4bc1-9683-2a6fe1e70855" released by "delete_volume" :: held 0.939s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:27:40 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Created reservations ['22d61b0a-33af-4566-9f4e-338217dae5c3', 'a61d8969-84c4-4109-991a-03ffa7c14f32', '5e73f6e8-19ad-4824-b58e-96b20a268c21', '62792ec2-d647-40af-9ffa-5076d0c412b2'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:27:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:27:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:27:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:27:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:27:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:27:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.091s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:40 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:27:41 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Deleted volume successfully. Sep 22 11:27:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4bce7f88-1516-4db8-b3d5-49a4dd385c0c tempest-VolumeSnapshotQuotasNegativeTestJSON-1767842239 None] Lock "cinder-97cc899a-7f0e-4bc1-9683-2a6fe1e70855-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:27:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-71044e84-2561-4086-b1e1-1d4cc565c8fa req-173d1fea-e697-4c25-897f-a25b3dde648e tempest-TestInstancesWithCinderVolumes-450250349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:27:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-71044e84-2561-4086-b1e1-1d4cc565c8fa req-173d1fea-e697-4c25-897f-a25b3dde648e tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:27:49 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd191e6-f23e-4ad0-b56a-69beb832a60a]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:27:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-71044e84-2561-4086-b1e1-1d4cc565c8fa req-173d1fea-e697-4c25-897f-a25b3dde648e tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a16f6719-ec36-4496-8cb8-9119be9ab2d0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:50 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Flow 'volume_create_manager' (5bb28dd8-fcbb-4398-9baa-7bcb0490bf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9867fe8b-e321-4986-aa55-17c69434551f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:27:50 devstack quobyte-client[83313]: System call of process 96144 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9867fe8b-e321-4986-aa55-17c69434551f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1247106396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef8cf308-99ff-441d-be41-4f33c4a4103b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='832ac0c1a32d45c792965c71c6e0f0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:27:50Z,use_quota=True,user_id='cf31e946588643f78cafd46a90f59b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67c288ec-4703-479a-b2aa-21ae9437ec51),volume_type_id=67c288ec-4703-479a-b2aa-21ae9437ec51)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e0ed919-ad19-4e9b-badb-5298233a73d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e0ed919-ad19-4e9b-badb-5298233a73d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41252b80-06bc-4fa4-89b9-8a1678e4a303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41252b80-06bc-4fa4-89b9-8a1678e4a303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef8cf308-99ff-441d-be41-4f33c4a4103b', 'volume_name': 'volume-ef8cf308-99ff-441d-be41-4f33c4a4103b', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74639cdc-a15f-4432-8acc-469cad017bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74639cdc-a15f-4432-8acc-469cad017bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f99bcb66-d8fb-4899-8865-bf97c18b20db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:27:50 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Volume ef8cf308-99ff-441d-be41-4f33c4a4103b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef8cf308-99ff-441d-be41-4f33c4a4103b', 'volume_size': 1} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-71044e84-2561-4086-b1e1-1d4cc565c8fa req-173d1fea-e697-4c25-897f-a25b3dde648e tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a16f6719-ec36-4496-8cb8-9119be9ab2d0" returned: 0 in 0.713s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-71044e84-2561-4086-b1e1-1d4cc565c8fa req-173d1fea-e697-4c25-897f-a25b3dde648e tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.763s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.017s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1247106396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef8cf308-99ff-441d-be41-4f33c4a4103b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='832ac0c1a32d45c792965c71c6e0f0c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:27:50Z,use_quota=True,user_id='cf31e946588643f78cafd46a90f59b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67c288ec-4703-479a-b2aa-21ae9437ec51),volume_type_id=67c288ec-4703-479a-b2aa-21ae9437ec51)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Creating volume ef8cf308-99ff-441d-be41-4f33c4a4103b {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:27:50 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:27:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ef8cf308-99ff-441d-be41-4f33c4a4103b 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:50 devstack quobyte-client[83313]: System call of process 96147 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:27:50 devstack quobyte-client[83313]: System call of process 96147 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:27:50 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=112, name=volume-ef8cf308-99ff-441d-be41-4f33c4a4103b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:27:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ef8cf308-99ff-441d-be41-4f33c4a4103b 1073741824" returned: 0 in 0.536s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ef8cf308-99ff-441d-be41-4f33c4a4103b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-71044e84-2561-4086-b1e1-1d4cc565c8fa req-173d1fea-e697-4c25-897f-a25b3dde648e tempest-TestInstancesWithCinderVolumes-450250349 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-a16f6719-ec36-4496-8cb8-9119be9ab2d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f332a18-3b8f-4fe4-84bc-858defac3447', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:27:51 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-71044e84-2561-4086-b1e1-1d4cc565c8fa req-173d1fea-e697-4c25-897f-a25b3dde648e tempest-TestInstancesWithCinderVolumes-450250349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:27:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ef8cf308-99ff-441d-be41-4f33c4a4103b" returned: 0 in 0.396s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] <== create_volume: return (974ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:27:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:27:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f99bcb66-d8fb-4899-8865-bf97c18b20db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef8cf308-99ff-441d-be41-4f33c4a4103b', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:27:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646bcda3-9b1e-407a-8be0-eed98cc1fb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:27:51 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Volume volume-ef8cf308-99ff-441d-be41-4f33c4a4103b (ef8cf308-99ff-441d-be41-4f33c4a4103b): created successfully Sep 22 11:27:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646bcda3-9b1e-407a-8be0-eed98cc1fb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:27:51 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Flow 'volume_create_manager' (5bb28dd8-fcbb-4398-9baa-7bcb0490bf55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:27:51 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-71044e84-2561-4086-b1e1-1d4cc565c8fa req-173d1fea-e697-4c25-897f-a25b3dde648e tempest-TestInstancesWithCinderVolumes-450250349 None] attachment_update completed successfully. Sep 22 11:27:51 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-09836a1f-a084-427e-ad74-7fa9e86b84a5 tempest-VolumeTypesAccessTest-130989134 None] Created volume successfully. Sep 22 11:27:52 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Acquiring lock "cinder-ef8cf308-99ff-441d-be41-4f33c4a4103b-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:27:52 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Lock "cinder-ef8cf308-99ff-441d-be41-4f33c4a4103b-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:27:52 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:27:52 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Acquiring lock "cinder-quobyte-ef8cf308-99ff-441d-be41-4f33c4a4103b" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:27:52 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Lock "cinder-quobyte-ef8cf308-99ff-441d-be41-4f33c4a4103b" acquired by "delete_volume" :: waited 0.024s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:27:52 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b19e714-5c0a-4e93-988a-620cfd738a97]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:27:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ef8cf308-99ff-441d-be41-4f33c4a4103b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ef8cf308-99ff-441d-be41-4f33c4a4103b" returned: 0 in 0.485s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ef8cf308-99ff-441d-be41-4f33c4a4103b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ef8cf308-99ff-441d-be41-4f33c4a4103b" returned: 0 in 0.206s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:53 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Lock "cinder-quobyte-ef8cf308-99ff-441d-be41-4f33c4a4103b" released by "delete_volume" :: held 0.893s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:27:53 devstack cinder-volume[83310]: WARNING cinder.quota [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1189227154 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1189227154, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:27:53 devstack cinder-volume[83310]: WARNING cinder.quota [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1189227154 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1189227154, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:27:53 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Created reservations ['2a5691d2-c06e-48eb-a336-a47acb543be3', '30ea21a6-1b2d-4b07-b024-3fb45ee20be0', '9cf36ac4-5533-4199-82e0-12cf770d09b5', '80ffde37-c6b7-4ffa-b8fe-d09e6981b8fa'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:27:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:27:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:27:53 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:27:53 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:27:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:27:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:27:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.136s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:27:53 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:27:54 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Deleted volume successfully. Sep 22 11:27:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9b1d5313-70c3-4364-957f-2503cef1954d tempest-VolumeTypesAccessTest-130989134 None] Lock "cinder-ef8cf308-99ff-441d-be41-4f33c4a4103b-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:28:08 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=28,cinder:DELETE=3,cinder:SELECT=24,cinder:INSERT=7 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:28:08 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=35,cinder:UPDATE=32,cinder:INSERT=5,cinder:DELETE=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:28:10 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:28:10 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:28:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Flow 'volume_create_manager' (59705ddd-f6d0-4a0d-81a5-1b3a83325165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:28:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a69dd1-9d73-44c6-bfca-77167d4cd78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a69dd1-9d73-44c6-bfca-77167d4cd78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1874248747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b30424-14df-41bc-97bd-ad9d4ceb8ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec2fa40f88648e2b24d7cf329af29e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:28:11Z,use_quota=True,user_id='dd65684b9bf848ff9a2a444b5d8628be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e789a86f-e0f8-4fb9-9740-9df189a52dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e789a86f-e0f8-4fb9-9740-9df189a52dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa95dcf-3218-4ba0-aacb-664b00ed8980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:11 devstack cinder-volume[83310]: DEBUG cinder.image.glance [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Creating Keystone auth plugin from conf {{(pid=83310) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 22 11:28:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa95dcf-3218-4ba0-aacb-664b00ed8980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f3b30424-14df-41bc-97bd-ad9d4ceb8ae3', 'volume_name': 'volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3', 'volume_size': 1, 'image_id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a739f36f4ea4c5eb46d43587eb0544d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'created_at': datetime.datetime(2025, 9, 22, 8, 49, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 8, 49, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a1d9109-49e8-406b-a105-f8fc540ab994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8393e6f4-ab31-475e-8f31-ded5fafa17e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8393e6f4-ab31-475e-8f31-ded5fafa17e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063f1b63-f3e6-4761-b476-a59c85ebbbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:11 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Volume f3b30424-14df-41bc-97bd-ad9d4ceb8ae3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3', 'volume_size': 1, 'image_id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a739f36f4ea4c5eb46d43587eb0544d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'created_at': datetime.datetime(2025, 9, 22, 8, 49, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 8, 49, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a1d9109-49e8-406b-a105-f8fc540ab994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 22 11:28:11 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Cloning f3b30424-14df-41bc-97bd-ad9d4ceb8ae3 from image 1a1d9109-49e8-406b-a105-f8fc540ab994 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}]). {{(pid=83310) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 22 11:28:11 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_u0saxkqudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 22 11:28:11 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Image download 20.69 MB at 20.69 MB/s Sep 22 11:28:11 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e44bfc-9a99-4f1d-bee7-933300bd4bde]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:28:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_u0saxkqudevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:12 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_u0saxkqudevstack@QuobyteHD Sep 22 11:28:12 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 11:28:13 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Sep 22 11:28:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_u0saxkqudevstack@QuobyteHD" returned: 0 in 1.942s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:13 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Temporary image 1a1d9109-49e8-406b-a105-f8fc540ab994 is fetched for user dd65684b9bf848ff9a2a444b5d8628be. {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 22 11:28:14 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dccd15-1afd-465a-83f8-a6c628746de0]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:28:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_u0saxkqudevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:14 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_u0saxkqudevstack@QuobyteHD Sep 22 11:28:14 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 11:28:16 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Sep 22 11:28:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_u0saxkqudevstack@QuobyteHD" returned: 0 in 1.944s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:28:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:28:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1874248747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b30424-14df-41bc-97bd-ad9d4ceb8ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec2fa40f88648e2b24d7cf329af29e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:28:11Z,use_quota=True,user_id='dd65684b9bf848ff9a2a444b5d8628be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:28:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Creating volume f3b30424-14df-41bc-97bd-ad9d4ceb8ae3 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:28:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:28:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:28:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:28:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:28:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:28:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:28:16 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:28:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:16 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=113, name=volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:28:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3 1073741824" returned: 0 in 0.343s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3" returned: 0 in 0.126s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] <== create_volume: return (555ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:28:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.585s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:28:16 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Attempting download of 1a1d9109-49e8-406b-a105-f8fc540ab994 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}])) to volume f3b30424-14df-41bc-97bd-ad9d4ceb8ae3. {{(pid=83310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 22 11:28:17 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b526a8-e756-43b8-93d6-dfd0c497f336]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:28:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_j33gm0id {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_j33gm0id" returned: 0 in 0.349s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_j33gm0id {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:28:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:28:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:28:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:28:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:28:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:28:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.112s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:28:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_j33gm0id" returned: 1 in 0.492s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_j33gm0id' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:28:17 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[1529ce3b-bed6-4b84-865c-c5850d2e22f0]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:28:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_u0saxkqudevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_u0saxkqudevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:18 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] 1a1d9109-49e8-406b-a105-f8fc540ab994 was qcow2, converting to raw {{(pid=83310) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 22 11:28:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_u0saxkqudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:18 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=113, name=volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:28:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_u0saxkqudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3" returned: 0 in 0.885s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:19 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_u0saxkqudevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3 {{(pid=83310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 22 11:28:19 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Converted 112.00 MB image at 112.00 MB/s Sep 22 11:28:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3 1G" returned: 0 in 0.154s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:19 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e290da7-5343-4394-84b9-b3b8ae4db3ee]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:28:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:19 devstack quobyte-client[83313]: System call of process 96237 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:28:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3" returned: 0 in 0.382s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3" returned: 1 in 0.336s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:28:20 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Downloaded image 1a1d9109-49e8-406b-a105-f8fc540ab994 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}])) to volume f3b30424-14df-41bc-97bd-ad9d4ceb8ae3 successfully. {{(pid=83310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 22 11:28:20 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Temporary image 1a1d9109-49e8-406b-a105-f8fc540ab994 for user dd65684b9bf848ff9a2a444b5d8628be is deleted. {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 22 11:28:20 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Marking volume f3b30424-14df-41bc-97bd-ad9d4ceb8ae3 as bootable. {{(pid=83310) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 22 11:28:20 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Copying metadata from image 1a1d9109-49e8-406b-a105-f8fc540ab994 to f3b30424-14df-41bc-97bd-ad9d4ceb8ae3. {{(pid=83310) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 11:28:20 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Creating volume glance metadata for volume f3b30424-14df-41bc-97bd-ad9d4ceb8ae3 backed by image 1a1d9109-49e8-406b-a105-f8fc540ab994 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83310) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 11:28:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063f1b63-f3e6-4761-b476-a59c85ebbbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3', 'volume_size': 1, 'image_id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a739f36f4ea4c5eb46d43587eb0544d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'created_at': datetime.datetime(2025, 9, 22, 8, 49, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 8, 49, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a1d9109-49e8-406b-a105-f8fc540ab994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426bbdc6-2257-4f53-9ca2-8af0a6dd3406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:20 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Volume volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3 (f3b30424-14df-41bc-97bd-ad9d4ceb8ae3): created successfully Sep 22 11:28:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426bbdc6-2257-4f53-9ca2-8af0a6dd3406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Flow 'volume_create_manager' (59705ddd-f6d0-4a0d-81a5-1b3a83325165) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:28:20 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-707655f1-63e5-47b0-8613-dae159d5001d tempest-VolumesImageMetadata-1109323474 None] Created volume successfully. Sep 22 11:28:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] Acquiring lock "cinder-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:28:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] Lock "cinder-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:28:22 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:28:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] Acquiring lock "cinder-quobyte-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:28:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] Lock "cinder-quobyte-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3" acquired by "delete_volume" :: waited 0.011s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:28:22 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb866509-14e4-4ca7-a784-ee4a47d3661b]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:28:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:22 devstack quobyte-client[83313]: System call of process 96242 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:28:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3" returned: 0 in 0.369s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3" returned: 1 in 0.365s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:28:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3" returned: 0 in 0.186s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:23 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] Lock "cinder-quobyte-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3" released by "delete_volume" :: held 1.095s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:28:23 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] Created reservations ['b6a1c4c4-9fd8-470a-a541-1e822c57a807', '8c05387a-7750-4459-823a-2c8c693dfe0b', '994aca83-e360-4f28-87b6-80f0608c93ed', '231de80e-9ba6-46df-a039-cad642259eef'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:28:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:28:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:28:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:28:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:28:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:28:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.083s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:23 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:28:23 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] Deleted volume successfully. Sep 22 11:28:24 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4439503a-c6a8-4b9a-8787-66684b0f4ba5 tempest-VolumesImageMetadata-1109323474 None] Lock "cinder-f3b30424-14df-41bc-97bd-ad9d4ceb8ae3-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:28:27 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:28:27 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Flow 'volume_create_manager' (c01b48de-16d3-49e5-9239-878f1fb1867c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ec85d8-46f7-47fe-9954-ce2924c65fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:28 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-eafbff5c-38cf-4bb8-aed7-6833a791b436 req-a7b46fb2-ccfb-455e-a612-565b87251ece tempest-TestInstancesWithCinderVolumes-450250349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ec85d8-46f7-47fe-9954-ce2924c65fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2131030129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecfbaaa3-e976-40df-8724-e7c6294ee944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c76d6d4a790407b945a32ebff4a660a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:28:28Z,use_quota=True,user_id='c1a4de6f889d49f4bca1e24e347bea98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f29998-713d-4491-9d06-72b5349e3005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f29998-713d-4491-9d06-72b5349e3005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741f7e96-c0fc-4d38-bdf5-7b7d8da9fa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741f7e96-c0fc-4d38-bdf5-7b7d8da9fa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecfbaaa3-e976-40df-8724-e7c6294ee944', 'volume_name': 'volume-ecfbaaa3-e976-40df-8724-e7c6294ee944', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa485eaa-ae79-4a27-8e04-d0b011ac8c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa485eaa-ae79-4a27-8e04-d0b011ac8c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5da05b-0cae-4e41-bdac-24be14d5b358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:28 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Volume ecfbaaa3-e976-40df-8724-e7c6294ee944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecfbaaa3-e976-40df-8724-e7c6294ee944', 'volume_size': 1} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2131030129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecfbaaa3-e976-40df-8724-e7c6294ee944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c76d6d4a790407b945a32ebff4a660a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:28:28Z,use_quota=True,user_id='c1a4de6f889d49f4bca1e24e347bea98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Creating volume ecfbaaa3-e976-40df-8724-e7c6294ee944 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:28:28 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ecfbaaa3-e976-40df-8724-e7c6294ee944 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:28 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=114, name=volume-ecfbaaa3-e976-40df-8724-e7c6294ee944, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:28:28 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-eafbff5c-38cf-4bb8-aed7-6833a791b436 req-a7b46fb2-ccfb-455e-a612-565b87251ece tempest-TestInstancesWithCinderVolumes-450250349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:28:28 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-eafbff5c-38cf-4bb8-aed7-6833a791b436 req-a7b46fb2-ccfb-455e-a612-565b87251ece tempest-TestInstancesWithCinderVolumes-450250349 None] Terminate volume connection completed successfully. Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-eafbff5c-38cf-4bb8-aed7-6833a791b436 req-a7b46fb2-ccfb-455e-a612-565b87251ece tempest-TestInstancesWithCinderVolumes-450250349 None] Deleting attachment 2050d508-e03f-4a28-a23c-37a8c9ce38c0. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ecfbaaa3-e976-40df-8724-e7c6294ee944 1073741824" returned: 0 in 0.414s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ecfbaaa3-e976-40df-8724-e7c6294ee944 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ecfbaaa3-e976-40df-8724-e7c6294ee944" returned: 0 in 0.143s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] <== create_volume: return (606ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.619s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5da05b-0cae-4e41-bdac-24be14d5b358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecfbaaa3-e976-40df-8724-e7c6294ee944', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3576dbb-cc52-47b0-982a-1f225179158c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:29 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Volume volume-ecfbaaa3-e976-40df-8724-e7c6294ee944 (ecfbaaa3-e976-40df-8724-e7c6294ee944): created successfully Sep 22 11:28:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3576dbb-cc52-47b0-982a-1f225179158c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Flow 'volume_create_manager' (c01b48de-16d3-49e5-9239-878f1fb1867c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:28:29 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-a82b5947-5f70-460f-b409-a7d928206449 tempest-AbsoluteLimitsTests-285610748 None] Created volume successfully. Sep 22 11:28:29 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Acquiring lock "cinder-ad1b2aa5-fa7a-4585-9173-283707840fa4-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:28:29 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "cinder-ad1b2aa5-fa7a-4585-9173-283707840fa4-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:28:30 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:28:30 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Acquiring lock "cinder-quobyte-ad1b2aa5-fa7a-4585-9173-283707840fa4" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:28:30 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "cinder-quobyte-ad1b2aa5-fa7a-4585-9173-283707840fa4" acquired by "delete_volume" :: waited 0.023s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:28:30 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[daef0f76-79d1-46a3-b252-09a67fea849c]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:28:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ad1b2aa5-fa7a-4585-9173-283707840fa4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:30 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] Acquiring lock "cinder-ecfbaaa3-e976-40df-8724-e7c6294ee944-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:28:30 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] Lock "cinder-ecfbaaa3-e976-40df-8724-e7c6294ee944-delete_volume" acquired by "delete_volume" :: waited 0.152s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:28:30 devstack quobyte-client[83313]: System call of process 96292 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:28:30 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:28:30 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] Acquiring lock "cinder-quobyte-ecfbaaa3-e976-40df-8724-e7c6294ee944" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:28:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ad1b2aa5-fa7a-4585-9173-283707840fa4" returned: 0 in 0.774s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ad1b2aa5-fa7a-4585-9173-283707840fa4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ad1b2aa5-fa7a-4585-9173-283707840fa4" returned: 0 in 0.189s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] Lock "cinder-quobyte-ecfbaaa3-e976-40df-8724-e7c6294ee944" acquired by "delete_volume" :: waited 0.246s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:28:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "cinder-quobyte-ad1b2aa5-fa7a-4585-9173-283707840fa4" released by "delete_volume" :: held 1.122s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:28:31 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[794a0a7a-1d5d-43fb-aee2-95319af1876c]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:28:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ecfbaaa3-e976-40df-8724-e7c6294ee944 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:31 devstack cinder-volume[83310]: WARNING cinder.quota [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1844655709-1684501605 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1844655709-1684501605, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:28:31 devstack cinder-volume[83310]: WARNING cinder.quota [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1844655709-1684501605 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1844655709-1684501605, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:28:31 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Created reservations ['b5f8da5e-4dc6-41ab-b146-4104593f3daa', '53b6101e-5b27-4200-8c84-8099f1ab37f8', 'c58d66f7-f9c0-4692-b300-1694c4811ddb', '5868b1df-cbcb-4d30-9391-06b102f0c17b'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:28:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:28:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:28:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:28:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:28:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:28:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ecfbaaa3-e976-40df-8724-e7c6294ee944" returned: 0 in 0.831s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ecfbaaa3-e976-40df-8724-e7c6294ee944 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.303s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:32 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:28:32 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Deleted volume successfully. Sep 22 11:28:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ecfbaaa3-e976-40df-8724-e7c6294ee944" returned: 0 in 0.349s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:32 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] Lock "cinder-quobyte-ecfbaaa3-e976-40df-8724-e7c6294ee944" released by "delete_volume" :: held 1.447s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:28:32 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-36bd0767-6480-4340-9a1a-fe1cdeb25cfc tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "cinder-ad1b2aa5-fa7a-4585-9173-283707840fa4-delete_volume" released by "delete_volume" :: held 2.872s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:28:32 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] Created reservations ['8daa4ef7-516f-4df2-8184-e555b6ac3321', 'af3f7ba0-7720-42cc-9ac5-c699c842d55a', 'c7d3fb7e-1ba3-4a0c-8ced-c02f57d7e9c3', 'cabb4e6e-cccc-4885-bd4a-a4c22dcebd4b'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:28:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:28:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:28:32 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:28:32 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:28:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:28:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.104s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:33 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:28:33 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] Deleted volume successfully. Sep 22 11:28:33 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-64400141-06fc-4a56-8190-4243bb65a17c tempest-AbsoluteLimitsTests-285610748 None] Lock "cinder-ecfbaaa3-e976-40df-8724-e7c6294ee944-delete_volume" released by "delete_volume" :: held 2.793s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:28:40 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Flow 'volume_create_manager' (59bf42ed-c2fd-447f-9ed2-7b852b02dce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a61d76f-1479-4cce-b996-49972ce6dee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a61d76f-1479-4cce-b996-49972ce6dee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1303539290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86facfd3-47ea-4582-9b3c-4b55bc1b5992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60e3feae45644479e36941e439a63cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:28:40Z,use_quota=True,user_id='f63e8a2778544236a29a8330e4465ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d86f65-4b31-4a59-8a01-b8f961e42e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d86f65-4b31-4a59-8a01-b8f961e42e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce27e504-8a24-470a-bea3-a7f38544657a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce27e504-8a24-470a-bea3-a7f38544657a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86facfd3-47ea-4582-9b3c-4b55bc1b5992', 'volume_name': 'volume-86facfd3-47ea-4582-9b3c-4b55bc1b5992', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c72677b-b7e3-4fa9-8bcd-707c1ad8e179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c72677b-b7e3-4fa9-8bcd-707c1ad8e179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99083d7a-32b8-4893-a09e-a84977086c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:40 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Volume 86facfd3-47ea-4582-9b3c-4b55bc1b5992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86facfd3-47ea-4582-9b3c-4b55bc1b5992', 'volume_size': 1} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1303539290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86facfd3-47ea-4582-9b3c-4b55bc1b5992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60e3feae45644479e36941e439a63cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:28:40Z,use_quota=True,user_id='f63e8a2778544236a29a8330e4465ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Creating volume 86facfd3-47ea-4582-9b3c-4b55bc1b5992 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:28:40 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:28:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-86facfd3-47ea-4582-9b3c-4b55bc1b5992 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:40 devstack quobyte-client[83313]: System call of process 96331 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:28:40 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=115, name=volume-86facfd3-47ea-4582-9b3c-4b55bc1b5992, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:28:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-86facfd3-47ea-4582-9b3c-4b55bc1b5992 1073741824" returned: 0 in 0.371s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-86facfd3-47ea-4582-9b3c-4b55bc1b5992 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-86facfd3-47ea-4582-9b3c-4b55bc1b5992" returned: 0 in 0.086s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] <== create_volume: return (525ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:28:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.538s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:28:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99083d7a-32b8-4893-a09e-a84977086c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86facfd3-47ea-4582-9b3c-4b55bc1b5992', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981b1730-f98a-4f3b-9177-7852764671a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:41 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Volume volume-86facfd3-47ea-4582-9b3c-4b55bc1b5992 (86facfd3-47ea-4582-9b3c-4b55bc1b5992): created successfully Sep 22 11:28:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (981b1730-f98a-4f3b-9177-7852764671a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Flow 'volume_create_manager' (59bf42ed-c2fd-447f-9ed2-7b852b02dce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:28:41 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-bc816997-e03f-4b74-8c31-add48e7b75f2 tempest-VolumesTransfersV355Test-231568304 None] Created volume successfully. Sep 22 11:28:43 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-320d5c06-cccf-421f-a7fa-0cdbbf894246 tempest-VolumesTransfersV355Test-1348963142 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:28:43 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-320d5c06-cccf-421f-a7fa-0cdbbf894246 tempest-VolumesTransfersV355Test-1348963142 None] Transfer volume completed successfully. Sep 22 11:28:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] Acquiring lock "cinder-86facfd3-47ea-4582-9b3c-4b55bc1b5992-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:28:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] Lock "cinder-86facfd3-47ea-4582-9b3c-4b55bc1b5992-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:28:44 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:28:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] Acquiring lock "cinder-quobyte-86facfd3-47ea-4582-9b3c-4b55bc1b5992" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:28:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] Lock "cinder-quobyte-86facfd3-47ea-4582-9b3c-4b55bc1b5992" acquired by "delete_volume" :: waited 0.014s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:28:44 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bf7f1c-b6c0-4fec-8956-cec318a1613e]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:28:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-86facfd3-47ea-4582-9b3c-4b55bc1b5992 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-86facfd3-47ea-4582-9b3c-4b55bc1b5992" returned: 0 in 0.451s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-86facfd3-47ea-4582-9b3c-4b55bc1b5992 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-86facfd3-47ea-4582-9b3c-4b55bc1b5992" returned: 0 in 0.117s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] Lock "cinder-quobyte-86facfd3-47ea-4582-9b3c-4b55bc1b5992" released by "delete_volume" :: held 0.739s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:28:45 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] Created reservations ['c26130c9-537c-4726-8b41-5874f79999c4', 'a089cdd2-8dde-4641-8472-c75043b26c05', '9414cc00-896e-4652-b8d5-85702da53a01', 'd06f3a37-06eb-4668-906d-a2e29d6f7400'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:28:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:28:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:28:45 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:28:45 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:28:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:28:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.087s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:45 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:28:46 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] Deleted volume successfully. Sep 22 11:28:46 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c09dee15-517b-4502-99fb-91b22691933c tempest-VolumesTransfersV355Test-259519280 None] Lock "cinder-86facfd3-47ea-4582-9b3c-4b55bc1b5992-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:28:47 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Flow 'volume_create_manager' (35d59a68-6c67-4104-8522-6d1a40372fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0344475-976e-4a9a-a54b-38420670947a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0344475-976e-4a9a-a54b-38420670947a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-435319517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46027494-4455-4613-93e5-94c74f280a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60e3feae45644479e36941e439a63cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:28:47Z,use_quota=True,user_id='f63e8a2778544236a29a8330e4465ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69dd31e1-3747-4caa-a8f8-dfd841f65c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69dd31e1-3747-4caa-a8f8-dfd841f65c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42d2fc8-794c-4ce5-9021-716f8b28bce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42d2fc8-794c-4ce5-9021-716f8b28bce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46027494-4455-4613-93e5-94c74f280a79', 'volume_name': 'volume-46027494-4455-4613-93e5-94c74f280a79', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d789381a-84ed-4b3f-ad69-95e6cb465e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d789381a-84ed-4b3f-ad69-95e6cb465e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a94886b-45e9-4303-b29c-8492c6189c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:47 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Volume 46027494-4455-4613-93e5-94c74f280a79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46027494-4455-4613-93e5-94c74f280a79', 'volume_size': 1} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-435319517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46027494-4455-4613-93e5-94c74f280a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60e3feae45644479e36941e439a63cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:28:47Z,use_quota=True,user_id='f63e8a2778544236a29a8330e4465ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Creating volume 46027494-4455-4613-93e5-94c74f280a79 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:28:47 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-46027494-4455-4613-93e5-94c74f280a79 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:47 devstack quobyte-client[83313]: System call of process 96373 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:28:47 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=116, name=volume-46027494-4455-4613-93e5-94c74f280a79, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-46027494-4455-4613-93e5-94c74f280a79 1073741824" returned: 0 in 0.349s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-46027494-4455-4613-93e5-94c74f280a79 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-46027494-4455-4613-93e5-94c74f280a79" returned: 0 in 0.087s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:48 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] <== create_volume: return (533ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:28:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.546s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:28:48 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a94886b-45e9-4303-b29c-8492c6189c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46027494-4455-4613-93e5-94c74f280a79', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:48 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21a59a5-26e2-4449-82e0-7185441dcb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:48 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Volume volume-46027494-4455-4613-93e5-94c74f280a79 (46027494-4455-4613-93e5-94c74f280a79): created successfully Sep 22 11:28:48 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21a59a5-26e2-4449-82e0-7185441dcb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:48 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Flow 'volume_create_manager' (35d59a68-6c67-4104-8522-6d1a40372fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:28:48 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-6d44bb6f-14e8-447e-9c9e-081a56e569f5 tempest-VolumesTransfersV355Test-231568304 None] Created volume successfully. Sep 22 11:28:49 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] Acquiring lock "cinder-46027494-4455-4613-93e5-94c74f280a79-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:28:49 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] Lock "cinder-46027494-4455-4613-93e5-94c74f280a79-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:28:50 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:28:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] Acquiring lock "cinder-quobyte-46027494-4455-4613-93e5-94c74f280a79" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:28:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] Lock "cinder-quobyte-46027494-4455-4613-93e5-94c74f280a79" acquired by "delete_volume" :: waited 0.014s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:28:50 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9351b4-6886-42ea-beff-0f13eca3c43a]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:28:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-46027494-4455-4613-93e5-94c74f280a79 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-46027494-4455-4613-93e5-94c74f280a79" returned: 0 in 0.407s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-46027494-4455-4613-93e5-94c74f280a79 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-46027494-4455-4613-93e5-94c74f280a79" returned: 0 in 0.107s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] Lock "cinder-quobyte-46027494-4455-4613-93e5-94c74f280a79" released by "delete_volume" :: held 0.675s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:28:50 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] Created reservations ['7c9a97ea-2e6a-4030-8e06-ce37ec073526', '1b25f76c-3570-4ef4-a155-a734aa78468a', '1000d982-c2ba-45cf-9926-3016b7fde045', '1fb01dc0-a3d4-457f-9c4c-8402db44baf6'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:28:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:28:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:28:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:28:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:28:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:28:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.094s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:51 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:28:51 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] Deleted volume successfully. Sep 22 11:28:51 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c1c829e6-ba82-4cce-9087-8743434284fe tempest-VolumesTransfersV355Test-259519280 None] Lock "cinder-46027494-4455-4613-93e5-94c74f280a79-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:28:58 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Flow 'volume_create_manager' (d35bd8b4-e657-436b-bb9c-d91cfca33f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51c55fa-07fe-44a4-9dcc-45856ddd5b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51c55fa-07fe-44a4-9dcc-45856ddd5b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1037146298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b13d6cc191f448a4bf29d01063fc07b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:28:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:28:58Z,use_quota=True,user_id='b80f20dfaf5c4acab087fb8230e4fcb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bcd13c7-67df-4b5e-8d54-d509fbe7dcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bcd13c7-67df-4b5e-8d54-d509fbe7dcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f870acd2-f00d-468f-af64-85188b3b6cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f870acd2-f00d-468f-af64-85188b3b6cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5', 'volume_name': 'volume-5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5', 'volume_size': 2}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa87a3a7-7da2-4d9f-9cd4-ece38a1d300b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa87a3a7-7da2-4d9f-9cd4-ece38a1d300b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cfb8bae-5222-4434-b8b5-689aa9dac055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:58 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Volume 5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5', 'volume_size': 2} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1037146298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b13d6cc191f448a4bf29d01063fc07b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:28:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:28:58Z,use_quota=True,user_id='b80f20dfaf5c4acab087fb8230e4fcb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Creating volume 5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:28:58 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:28:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5 2147483648 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:58 devstack quobyte-client[83313]: System call of process 96391 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:28:58 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=117, name=volume-5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:28:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5 2147483648" returned: 0 in 0.480s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:28:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5" returned: 0 in 0.103s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:28:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] <== create_volume: return (651ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:28:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:28:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cfb8bae-5222-4434-b8b5-689aa9dac055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5', 'volume_size': 2}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56849101-ce6c-4277-830f-ed5f6825a011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:28:59 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Volume volume-5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5 (5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5): created successfully Sep 22 11:28:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56849101-ce6c-4277-830f-ed5f6825a011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:28:59 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Flow 'volume_create_manager' (d35bd8b4-e657-436b-bb9c-d91cfca33f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:28:59 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-10b088f2-eec9-42df-aad0-f84e6a4b5feb tempest-VolumesCloneNegativeTest-2147221107 None] Created volume successfully. Sep 22 11:29:00 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-f07acc84-d6f4-44f8-b336-f23ebdb9c245 req-f6e161de-fa28-4973-9aea-e14220f17e14 tempest-TestInstancesWithCinderVolumes-450250349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:29:00 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-f07acc84-d6f4-44f8-b336-f23ebdb9c245 req-f6e161de-fa28-4973-9aea-e14220f17e14 tempest-TestInstancesWithCinderVolumes-450250349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:29:00 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-f07acc84-d6f4-44f8-b336-f23ebdb9c245 req-f6e161de-fa28-4973-9aea-e14220f17e14 tempest-TestInstancesWithCinderVolumes-450250349 None] Terminate volume connection completed successfully. Sep 22 11:29:00 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-f07acc84-d6f4-44f8-b336-f23ebdb9c245 req-f6e161de-fa28-4973-9aea-e14220f17e14 tempest-TestInstancesWithCinderVolumes-450250349 None] Deleting attachment 9f332a18-3b8f-4fe4-84bc-858defac3447. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:29:00 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] Acquiring lock "cinder-5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:29:00 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] Lock "cinder-5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:29:00 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:29:00 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] Acquiring lock "cinder-quobyte-5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:29:01 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] Lock "cinder-quobyte-5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5" acquired by "delete_volume" :: waited 0.014s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:29:01 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea58a92-0bed-4d99-b05f-cb38713e5c30]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:29:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:29:01 devstack quobyte-client[83313]: System call of process 96396 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:29:01 devstack quobyte-client[83313]: System call of process 96396 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:29:01 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Acquiring lock "cinder-a16f6719-ec36-4496-8cb8-9119be9ab2d0-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:29:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5" returned: 0 in 0.603s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:29:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:29:01 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "cinder-a16f6719-ec36-4496-8cb8-9119be9ab2d0-delete_volume" acquired by "delete_volume" :: waited 0.270s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:29:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5" returned: 0 in 0.430s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:29:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] Lock "cinder-quobyte-5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5" released by "delete_volume" :: held 1.119s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:29:02 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:29:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Acquiring lock "cinder-quobyte-a16f6719-ec36-4496-8cb8-9119be9ab2d0" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:29:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "cinder-quobyte-a16f6719-ec36-4496-8cb8-9119be9ab2d0" acquired by "delete_volume" :: waited 0.038s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:29:02 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e738e5-00f0-4ed7-a18b-8b0929f3f75a]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:29:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a16f6719-ec36-4496-8cb8-9119be9ab2d0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:29:02 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] Created reservations ['e5e09f67-9189-4b38-b2f2-f0ef7ead0fb7', '9d85566b-9f9c-40c6-9481-8f99d3567bcc', 'a807539d-169a-4353-818d-1ea593d1a3f8', 'a3cdcaff-b5dd-440c-b088-a2e000143cb0'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:29:02 devstack quobyte-client[83313]: System call of process 96400 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:29:02 devstack quobyte-client[83313]: System call of process 96400 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:29:02 devstack quobyte-client[83313]: System call of process 96400 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:29:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a16f6719-ec36-4496-8cb8-9119be9ab2d0" returned: 0 in 0.676s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:29:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a16f6719-ec36-4496-8cb8-9119be9ab2d0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:29:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:29:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.075s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:29:03 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:29:03 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:29:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.063s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:29:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:29:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a16f6719-ec36-4496-8cb8-9119be9ab2d0" returned: 0 in 0.472s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:29:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.334s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:29:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "cinder-quobyte-a16f6719-ec36-4496-8cb8-9119be9ab2d0" released by "delete_volume" :: held 1.400s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:29:03 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:29:03 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] Deleted volume successfully. Sep 22 11:29:04 devstack cinder-volume[83310]: WARNING cinder.quota [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-895565674-1232170903 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-895565674-1232170903, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:29:04 devstack cinder-volume[83310]: WARNING cinder.quota [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-895565674-1232170903 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-895565674-1232170903, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:29:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-8155bb0f-3a6c-48a2-9e21-100f3daa73c6 tempest-VolumesCloneNegativeTest-2147221107 None] Lock "cinder-5d13b0e0-39e9-43d6-aa8d-79ef17a38eb5-delete_volume" released by "delete_volume" :: held 3.194s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:29:04 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Created reservations ['206f2387-2297-42e7-9849-3bc7ccb4ee2b', 'cf86371e-b91f-4534-a771-912c0ddc4a9b', '9597c90d-9cd6-42ef-9e4e-585d0c2d3d29', '953d79ad-1784-48d9-8fe9-a5d16c46b0b1'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:29:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:29:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:29:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:29:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:29:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:29:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:29:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.186s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:29:04 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:29:04 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Deleted volume successfully. Sep 22 11:29:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e9a31a4f-3e73-45bc-9571-f068b71ccf38 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "cinder-a16f6719-ec36-4496-8cb8-9119be9ab2d0-delete_volume" released by "delete_volume" :: held 3.089s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:29:08 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Flow 'volume_create_manager' (2a0a0032-3e98-42ea-a4e9-a2118add8a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65143331-ee73-4e23-9537-0ba3f0558178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=48,cinder:UPDATE=61,cinder:INSERT=18,cinder:DELETE=6 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65143331-ee73-4e23-9537-0ba3f0558178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1125536819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3720f8a4-4ce9-4d5f-a33f-017b13765027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44eeb4bf59914999a4c68859f22c137a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:29:08Z,use_quota=True,user_id='412668d691974fb2bfb136d3405c810d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487c58d4-abc2-4388-8127-6a6b26d1dbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487c58d4-abc2-4388-8127-6a6b26d1dbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263a08bb-be5b-4627-98d5-12220ca915f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263a08bb-be5b-4627-98d5-12220ca915f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3720f8a4-4ce9-4d5f-a33f-017b13765027', 'volume_name': 'volume-3720f8a4-4ce9-4d5f-a33f-017b13765027', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69752e8c-fc0a-4244-9a2f-4e72327493c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69752e8c-fc0a-4244-9a2f-4e72327493c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366c4cdd-823d-46b2-82f3-c8449243c2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:29:08 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Volume 3720f8a4-4ce9-4d5f-a33f-017b13765027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3720f8a4-4ce9-4d5f-a33f-017b13765027', 'volume_size': 1} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1125536819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3720f8a4-4ce9-4d5f-a33f-017b13765027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44eeb4bf59914999a4c68859f22c137a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:29:08Z,use_quota=True,user_id='412668d691974fb2bfb136d3405c810d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Creating volume 3720f8a4-4ce9-4d5f-a33f-017b13765027 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:29:08 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:29:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3720f8a4-4ce9-4d5f-a33f-017b13765027 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:29:09 devstack quobyte-client[83313]: System call of process 96433 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:29:09 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=118, name=volume-3720f8a4-4ce9-4d5f-a33f-017b13765027, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:29:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3720f8a4-4ce9-4d5f-a33f-017b13765027 1073741824" returned: 0 in 0.914s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:29:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3720f8a4-4ce9-4d5f-a33f-017b13765027 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:29:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3720f8a4-4ce9-4d5f-a33f-017b13765027" returned: 0 in 0.162s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:29:09 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] <== create_volume: return (1260ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:29:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:29:10 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=54,cinder:INSERT=23,cinder:UPDATE=76,cinder:DELETE=6 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:29:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366c4cdd-823d-46b2-82f3-c8449243c2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3720f8a4-4ce9-4d5f-a33f-017b13765027', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:29:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32e4643-ebb5-4fa6-b395-91f7069d902f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:29:10 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Volume volume-3720f8a4-4ce9-4d5f-a33f-017b13765027 (3720f8a4-4ce9-4d5f-a33f-017b13765027): created successfully Sep 22 11:29:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32e4643-ebb5-4fa6-b395-91f7069d902f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:29:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Flow 'volume_create_manager' (2a0a0032-3e98-42ea-a4e9-a2118add8a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:29:10 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-91829004-dcf3-4396-b61a-a10f6839a419 tempest-VolumesNegativeTest-615567838 None] Created volume successfully. Sep 22 11:29:12 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-63ae970c-9e3b-4d15-b16b-f0d629c6e3f7 req-4f51506d-8649-4031-8129-38a55baa4f8a tempest-TestInstancesWithCinderVolumes-450250349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:29:12 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-63ae970c-9e3b-4d15-b16b-f0d629c6e3f7 req-4f51506d-8649-4031-8129-38a55baa4f8a tempest-TestInstancesWithCinderVolumes-450250349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:29:12 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-63ae970c-9e3b-4d15-b16b-f0d629c6e3f7 req-4f51506d-8649-4031-8129-38a55baa4f8a tempest-TestInstancesWithCinderVolumes-450250349 None] Terminate volume connection completed successfully. Sep 22 11:29:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-63ae970c-9e3b-4d15-b16b-f0d629c6e3f7 req-4f51506d-8649-4031-8129-38a55baa4f8a tempest-TestInstancesWithCinderVolumes-450250349 None] Deleting attachment f3f32aa4-9a8d-4841-986e-ddb5f806cf27. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:29:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Acquiring lock "cinder-920c9402-d08e-4926-aaf9-80358c9dd996-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:29:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "cinder-920c9402-d08e-4926-aaf9-80358c9dd996-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:29:15 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:29:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Acquiring lock "cinder-quobyte-920c9402-d08e-4926-aaf9-80358c9dd996" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:29:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "cinder-quobyte-920c9402-d08e-4926-aaf9-80358c9dd996" acquired by "delete_volume" :: waited 0.012s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:29:15 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3a3d98-f37c-4868-b39b-533907ed67d5]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:29:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:29:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996" returned: 0 in 0.389s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:29:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:29:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996" returned: 1 in 0.438s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:29:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:29:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:29:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-920c9402-d08e-4926-aaf9-80358c9dd996" returned: 0 in 0.088s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:29:16 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "cinder-quobyte-920c9402-d08e-4926-aaf9-80358c9dd996" released by "delete_volume" :: held 1.215s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:29:17 devstack cinder-volume[83310]: WARNING cinder.quota [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-320272699-991116721 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-320272699-991116721, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:29:17 devstack cinder-volume[83310]: WARNING cinder.quota [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-320272699-991116721 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-320272699-991116721, it is now deprecated. Please use the default quota class for default quota. Sep 22 11:29:17 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Created reservations ['668d19ed-7e9a-4700-a416-b689755507ee', '0c125704-6710-4475-81e4-4fd17c7b6ca6', '8b0af5f9-c8af-4758-a7a1-79f4d0aa9449', '77483010-dc6b-492d-8ed7-d622204d1ac8'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:29:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:29:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:29:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:29:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:29:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:29:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:29:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.128s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:29:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:29:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:29:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:29:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:29:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:29:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:29:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:29:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:29:17 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Deleted volume successfully. Sep 22 11:29:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.400s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:29:18 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:29:18 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-484788fa-8374-4766-95cc-c251522d6fe6 tempest-TestInstancesWithCinderVolumes-450250349 None] Lock "cinder-920c9402-d08e-4926-aaf9-80358c9dd996-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:29:27 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=10,cinder:SELECT=6,cinder:INSERT=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:29:28 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:DELETE=2,cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:29:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] Acquiring lock "cinder-3720f8a4-4ce9-4d5f-a33f-017b13765027-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:29:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] Lock "cinder-3720f8a4-4ce9-4d5f-a33f-017b13765027-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:29:57 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:29:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] Acquiring lock "cinder-quobyte-3720f8a4-4ce9-4d5f-a33f-017b13765027" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:29:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] Lock "cinder-quobyte-3720f8a4-4ce9-4d5f-a33f-017b13765027" acquired by "delete_volume" :: waited 0.015s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:29:57 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07f517a-b2a1-4156-9f65-ea1e5b945834]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:29:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3720f8a4-4ce9-4d5f-a33f-017b13765027 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:29:58 devstack quobyte-client[83313]: System call of process 96699 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:29:58 devstack quobyte-client[83313]: System call of process 96699 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:29:58 devstack quobyte-client[83313]: System call of process 96699 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:29:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3720f8a4-4ce9-4d5f-a33f-017b13765027" returned: 0 in 0.700s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:29:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3720f8a4-4ce9-4d5f-a33f-017b13765027 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:29:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3720f8a4-4ce9-4d5f-a33f-017b13765027" returned: 0 in 0.224s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:29:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] Lock "cinder-quobyte-3720f8a4-4ce9-4d5f-a33f-017b13765027" released by "delete_volume" :: held 1.074s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:29:58 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] Created reservations ['37bd8098-93e7-4ff3-86ff-8f8ef53d6ea2', '83aec9f2-ea4e-40f5-93ac-8b74c56a80ce', '88e12654-57cf-4c60-8d0b-f76fa8532553', '7e808c07-0f03-4c49-882f-0f876f3aaf15'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:29:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:29:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:29:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:29:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:29:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:29:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:29:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.141s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:29:59 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:29:59 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] Deleted volume successfully. Sep 22 11:29:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-0a33cda2-e023-4a64-a131-5e8969ee3fc1 tempest-VolumesNegativeTest-615567838 None] Lock "cinder-3720f8a4-4ce9-4d5f-a33f-017b13765027-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:04 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Flow 'volume_create_manager' (18b4967b-bb07-4b03-acfb-85eca7063c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cccc928-52a9-4965-a71f-bf9bd060ce85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cccc928-52a9-4965-a71f-bf9bd060ce85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2074558963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf86ca9-e012-463a-a0df-5ebe252d2d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050fe5c9c6214e958f005eca513bb723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:04Z,use_quota=True,user_id='05783a5d485c4b1ba62cd9c65a072d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7853b8-93fa-4546-a57b-5e2a40a2bfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7853b8-93fa-4546-a57b-5e2a40a2bfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f057cfe-d375-47a8-86ff-2d850c616340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f057cfe-d375-47a8-86ff-2d850c616340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf86ca9-e012-463a-a0df-5ebe252d2d64', 'volume_name': 'volume-abf86ca9-e012-463a-a0df-5ebe252d2d64', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a5f816-40a2-483b-a59d-1c2b48d8f972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a5f816-40a2-483b-a59d-1c2b48d8f972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222bc6b4-337a-4ad8-bc62-f5e26589f14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:04 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Volume abf86ca9-e012-463a-a0df-5ebe252d2d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf86ca9-e012-463a-a0df-5ebe252d2d64', 'volume_size': 1} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2074558963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf86ca9-e012-463a-a0df-5ebe252d2d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050fe5c9c6214e958f005eca513bb723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:04Z,use_quota=True,user_id='05783a5d485c4b1ba62cd9c65a072d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Creating volume abf86ca9-e012-463a-a0df-5ebe252d2d64 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:30:04 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:30:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-abf86ca9-e012-463a-a0df-5ebe252d2d64 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:04 devstack quobyte-client[83313]: System call of process 96705 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:04 devstack quobyte-client[83313]: System call of process 96705 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:05 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=119, name=volume-abf86ca9-e012-463a-a0df-5ebe252d2d64, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:30:05 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:05 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:30:05 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Flow 'volume_create_manager' (6dc3a872-f584-408f-b740-dae27a6d321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:05 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa114938-b13b-486b-9159-6be49d946d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-abf86ca9-e012-463a-a0df-5ebe252d2d64 1073741824" returned: 0 in 0.842s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:05 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:05 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:30:05 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Flow 'volume_create_manager' (21e2fc4b-7404-4ccd-ad3c-88155b79b74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:05 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660f7bdc-219a-4932-b52b-563f411e2e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-abf86ca9-e012-463a-a0df-5ebe252d2d64 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660f7bdc-219a-4932-b52b-563f411e2e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-134084799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7effbc9-65f8-4619-855a-e63a9a8308f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050fe5c9c6214e958f005eca513bb723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:05Z,use_quota=True,user_id='05783a5d485c4b1ba62cd9c65a072d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9e625d-903f-4ff2-86ab-31098c77fc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9e625d-903f-4ff2-86ab-31098c77fc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5253431b-f3e2-40fa-9b73-df6419e2adc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5253431b-f3e2-40fa-9b73-df6419e2adc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7effbc9-65f8-4619-855a-e63a9a8308f8', 'volume_name': 'volume-d7effbc9-65f8-4619-855a-e63a9a8308f8', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6322b1e7-97fe-49df-b61f-323989c430e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6322b1e7-97fe-49df-b61f-323989c430e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6989266-c8bb-40ec-8276-8dd85397bb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:06 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Volume d7effbc9-65f8-4619-855a-e63a9a8308f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7effbc9-65f8-4619-855a-e63a9a8308f8', 'volume_size': 1} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa114938-b13b-486b-9159-6be49d946d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1207172131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050fe5c9c6214e958f005eca513bb723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:04Z,use_quota=True,user_id='05783a5d485c4b1ba62cd9c65a072d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0d1605-7bdd-43cb-9dc6-48acde88b816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0d1605-7bdd-43cb-9dc6-48acde88b816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8600488c-3744-4172-91e8-6acea9b35382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8600488c-3744-4172-91e8-6acea9b35382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e', 'volume_name': 'volume-8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff30280-8bb7-4e33-81d5-b6c9841bd2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff30280-8bb7-4e33-81d5-b6c9841bd2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a5300a-7539-4e6c-a1f1-5ad1d7753fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:06 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Volume 8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e', 'volume_size': 1} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-abf86ca9-e012-463a-a0df-5ebe252d2d64" returned: 0 in 0.649s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] <== create_volume: return (1656ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.276s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-134084799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7effbc9-65f8-4619-855a-e63a9a8308f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050fe5c9c6214e958f005eca513bb723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:05Z,use_quota=True,user_id='05783a5d485c4b1ba62cd9c65a072d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Creating volume d7effbc9-65f8-4619-855a-e63a9a8308f8 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:30:06 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d7effbc9-65f8-4619-855a-e63a9a8308f8 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:06 devstack quobyte-client[83313]: System call of process 96709 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:06 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=120, name=volume-d7effbc9-65f8-4619-855a-e63a9a8308f8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:30:06 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Flow 'volume_create_manager' (6c588cbc-6878-4243-b7ed-8dd65195a44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:06 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca92f6df-930a-480a-8919-fe36e8cc7973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:07 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Flow 'volume_create_manager' (d0dee1a7-bec4-4889-8b63-10ff47e864eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d34c905c-e0d1-41a5-a499-6d02e5cc65f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222bc6b4-337a-4ad8-bc62-f5e26589f14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf86ca9-e012-463a-a0df-5ebe252d2d64', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd75319-ec81-4cb8-8ef4-2d499fd4b314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca92f6df-930a-480a-8919-fe36e8cc7973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1381398980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce1541a-28ba-4074-a7d1-8ce1de57c0ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050fe5c9c6214e958f005eca513bb723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:06Z,use_quota=True,user_id='05783a5d485c4b1ba62cd9c65a072d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93c7fa0-5428-4eed-adc8-b836dcbf932f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a93c7fa0-5428-4eed-adc8-b836dcbf932f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb18f27-2692-4794-a809-3424d2961642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb18f27-2692-4794-a809-3424d2961642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ce1541a-28ba-4074-a7d1-8ce1de57c0ff', 'volume_name': 'volume-4ce1541a-28ba-4074-a7d1-8ce1de57c0ff', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d7002d-9492-4afb-a094-6b14f099b6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d7002d-9492-4afb-a094-6b14f099b6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1fa456-8619-4e0f-a1d0-312f7c934d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:07 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Volume 4ce1541a-28ba-4074-a7d1-8ce1de57c0ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ce1541a-28ba-4074-a7d1-8ce1de57c0ff', 'volume_size': 1} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d7effbc9-65f8-4619-855a-e63a9a8308f8 1073741824" returned: 0 in 0.738s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d7effbc9-65f8-4619-855a-e63a9a8308f8 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d34c905c-e0d1-41a5-a499-6d02e5cc65f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1831653322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050fe5c9c6214e958f005eca513bb723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:06Z,use_quota=True,user_id='05783a5d485c4b1ba62cd9c65a072d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6498fce0-0cfa-4787-a532-59957fb708a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6498fce0-0cfa-4787-a532-59957fb708a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a7c113-7301-4643-aa6e-40e3ff51ce99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a7c113-7301-4643-aa6e-40e3ff51ce99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa', 'volume_name': 'volume-6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede92350-2b1d-436b-9be4-296930313183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede92350-2b1d-436b-9be4-296930313183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (634d7ba9-ad1f-41c8-9bdc-818b7741187f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:07 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Volume 6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa', 'volume_size': 1} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:07 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Volume volume-abf86ca9-e012-463a-a0df-5ebe252d2d64 (abf86ca9-e012-463a-a0df-5ebe252d2d64): created successfully Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd75319-ec81-4cb8-8ef4-2d499fd4b314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Flow 'volume_create_manager' (18b4967b-bb07-4b03-acfb-85eca7063c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d7effbc9-65f8-4619-855a-e63a9a8308f8" returned: 0 in 0.486s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] <== create_volume: return (1246ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.379s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1207172131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050fe5c9c6214e958f005eca513bb723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:04Z,use_quota=True,user_id='05783a5d485c4b1ba62cd9c65a072d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Creating volume 8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:30:07 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:30:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:07 devstack quobyte-client[83313]: System call of process 96713 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:07 devstack quobyte-client[83313]: System call of process 96713 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:07 devstack quobyte-client[83313]: System call of process 96713 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:07 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=121, name=volume-8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:30:08 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-7fe0e1d9-2c58-42fd-8b97-c8cad4d6a564 tempest-CreateVolumesFromImageTest-1012815066 None] Created volume successfully. Sep 22 11:30:08 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6989266-c8bb-40ec-8276-8dd85397bb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7effbc9-65f8-4619-855a-e63a9a8308f8', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:08 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81b7075-2ee0-4162-a984-65ac04799d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e 1073741824" returned: 0 in 0.544s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:08 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Volume volume-d7effbc9-65f8-4619-855a-e63a9a8308f8 (d7effbc9-65f8-4619-855a-e63a9a8308f8): created successfully Sep 22 11:30:08 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81b7075-2ee0-4162-a984-65ac04799d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:08 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Flow 'volume_create_manager' (21e2fc4b-7404-4ccd-ad3c-88155b79b74d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:08 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-29da733b-ca05-43ce-b4d8-6a31f1fb0020 tempest-CreateVolumesFromImageTest-1012815066 None] Created volume successfully. Sep 22 11:30:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e" returned: 0 in 0.459s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:08 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] <== create_volume: return (1036ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:30:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.583s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:08 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1381398980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce1541a-28ba-4074-a7d1-8ce1de57c0ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050fe5c9c6214e958f005eca513bb723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:06Z,use_quota=True,user_id='05783a5d485c4b1ba62cd9c65a072d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:30:08 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Creating volume 4ce1541a-28ba-4074-a7d1-8ce1de57c0ff {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:30:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:08 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:08 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:08 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:30:08 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:30:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4ce1541a-28ba-4074-a7d1-8ce1de57c0ff 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:09 devstack quobyte-client[83313]: System call of process 96717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:09 devstack quobyte-client[83313]: System call of process 96717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:09 devstack quobyte-client[83313]: System call of process 96717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:09 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=122, name=volume-4ce1541a-28ba-4074-a7d1-8ce1de57c0ff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:30:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a5300a-7539-4e6c-a1f1-5ad1d7753fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c18249-758d-49e5-8d7b-96366bcd637a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:09 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Volume volume-8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e (8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e): created successfully Sep 22 11:30:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c18249-758d-49e5-8d7b-96366bcd637a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:09 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Flow 'volume_create_manager' (6dc3a872-f584-408f-b740-dae27a6d321a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4ce1541a-28ba-4074-a7d1-8ce1de57c0ff 1073741824" returned: 0 in 0.579s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4ce1541a-28ba-4074-a7d1-8ce1de57c0ff {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:09 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-6e6529c8-9e70-4fcb-a943-fc193a480741 tempest-CreateVolumesFromImageTest-1012815066 None] Created volume successfully. Sep 22 11:30:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4ce1541a-28ba-4074-a7d1-8ce1de57c0ff" returned: 0 in 0.294s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:09 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] <== create_volume: return (909ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:30:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.286s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:09 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1831653322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050fe5c9c6214e958f005eca513bb723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:06Z,use_quota=True,user_id='05783a5d485c4b1ba62cd9c65a072d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:30:09 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Creating volume 6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:30:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:09 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:09 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:09 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:30:09 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:30:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:10 devstack quobyte-client[83313]: System call of process 96721 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:10 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=123, name=volume-6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:30:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1fa456-8619-4e0f-a1d0-312f7c934d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ce1541a-28ba-4074-a7d1-8ce1de57c0ff', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac09016e-b688-4041-a834-81f3ae2214f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:10 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Volume volume-4ce1541a-28ba-4074-a7d1-8ce1de57c0ff (4ce1541a-28ba-4074-a7d1-8ce1de57c0ff): created successfully Sep 22 11:30:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac09016e-b688-4041-a834-81f3ae2214f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Flow 'volume_create_manager' (6c588cbc-6878-4243-b7ed-8dd65195a44c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa 1073741824" returned: 0 in 0.504s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:10 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-a8f6302c-191b-4943-9bd2-7e8681137b2d tempest-CreateVolumesFromImageTest-1012815066 None] Created volume successfully. Sep 22 11:30:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa" returned: 0 in 0.308s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:10 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] <== create_volume: return (865ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:30:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (634d7ba9-ad1f-41c8-9bdc-818b7741187f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef20166-9183-4063-92ba-38aa7d62b5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:10 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Volume volume-6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa (6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa): created successfully Sep 22 11:30:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef20166-9183-4063-92ba-38aa7d62b5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Flow 'volume_create_manager' (d0dee1a7-bec4-4889-8b63-10ff47e864eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:10 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-8dd5f017-c266-4b98-8202-de9570402a58 tempest-CreateVolumesFromImageTest-1012815066 None] Created volume successfully. Sep 22 11:30:11 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "cinder-6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:11 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:11 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:11 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "cinder-quobyte-6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:11 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-quobyte-6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa" acquired by "delete_volume" :: waited 0.011s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:11 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c21be9-d6bf-4df2-84e4-4f72cb2fc5dd]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:30:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa" returned: 0 in 0.468s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa" returned: 0 in 0.109s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:12 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-quobyte-6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa" released by "delete_volume" :: held 0.744s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:12 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] Created reservations ['2621e4d1-d977-421f-b737-8afd543e59fb', '167dab17-f7a4-4a85-8757-aa6bf3d16e79', '4643fd97-4854-43c3-9da7-85ad17ac9fe6', 'e2ea01c0-270a-4be7-9e33-ba7f752e0042'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:30:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.104s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:13 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:30:13 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] Deleted volume successfully. Sep 22 11:30:13 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2299912e-c148-4ca7-80fa-2b684a95419a tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-6b2cf7ed-9a5c-4a9a-8cbb-6759a2fe19aa-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:13 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "cinder-4ce1541a-28ba-4074-a7d1-8ce1de57c0ff-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:13 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-4ce1541a-28ba-4074-a7d1-8ce1de57c0ff-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:13 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:13 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "cinder-quobyte-4ce1541a-28ba-4074-a7d1-8ce1de57c0ff" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:13 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-quobyte-4ce1541a-28ba-4074-a7d1-8ce1de57c0ff" acquired by "delete_volume" :: waited 0.010s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:13 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2748ce30-a5a1-4d69-924b-17f846b430f7]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:30:13 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4ce1541a-28ba-4074-a7d1-8ce1de57c0ff {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4ce1541a-28ba-4074-a7d1-8ce1de57c0ff" returned: 0 in 0.457s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4ce1541a-28ba-4074-a7d1-8ce1de57c0ff {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:14 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-4ce1541a-28ba-4074-a7d1-8ce1de57c0ff" returned: 0 in 0.093s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:14 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-quobyte-4ce1541a-28ba-4074-a7d1-8ce1de57c0ff" released by "delete_volume" :: held 0.704s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:14 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] Created reservations ['1ec2a245-cb8f-4227-8589-dce3273bb9d9', '89051297-f5aa-46cc-a784-b6aacd060e4c', '6d36881b-dead-4893-8c39-211f4687e288', 'c90cf71b-eb5c-4c3a-9965-7764814095bb'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:30:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:15 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:15 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.147s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:15 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:30:15 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] Deleted volume successfully. Sep 22 11:30:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-483b58f3-316a-494f-bf59-1e9e63c0506b tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-4ce1541a-28ba-4074-a7d1-8ce1de57c0ff-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:15 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "cinder-d7effbc9-65f8-4619-855a-e63a9a8308f8-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:16 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-d7effbc9-65f8-4619-855a-e63a9a8308f8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:16 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:16 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "cinder-quobyte-d7effbc9-65f8-4619-855a-e63a9a8308f8" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:16 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-quobyte-d7effbc9-65f8-4619-855a-e63a9a8308f8" acquired by "delete_volume" :: waited 0.015s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:16 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[02158c48-4aa7-45bc-8562-2d27e0385bfc]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:30:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d7effbc9-65f8-4619-855a-e63a9a8308f8 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:16 devstack quobyte-client[83313]: System call of process 96737 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d7effbc9-65f8-4619-855a-e63a9a8308f8" returned: 0 in 0.586s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d7effbc9-65f8-4619-855a-e63a9a8308f8 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d7effbc9-65f8-4619-855a-e63a9a8308f8" returned: 0 in 0.186s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:17 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-quobyte-d7effbc9-65f8-4619-855a-e63a9a8308f8" released by "delete_volume" :: held 1.075s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:30:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:18 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] Created reservations ['35ebda90-75d0-4526-9e4b-32c18e2578fc', 'b90c580e-87de-4e02-a01a-c52334e59874', '439ffc63-0135-45f3-8be4-06412c9e1c6f', 'de890910-4523-4ef9-a7d8-1079ca8e3c72'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:30:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.660s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:18 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:30:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.184s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:18 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:30:18 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] Deleted volume successfully. Sep 22 11:30:19 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-34cefd05-4f1b-4f5d-ac4f-c537236984e5 tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-d7effbc9-65f8-4619-855a-e63a9a8308f8-delete_volume" released by "delete_volume" :: held 3.213s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:19 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "cinder-8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:19 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:19 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:19 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "cinder-quobyte-8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:19 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-quobyte-8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e" acquired by "delete_volume" :: waited 0.018s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:19 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3926bff8-048c-4b3e-8355-fc9f92923824]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:30:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e" returned: 0 in 0.610s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e" returned: 0 in 0.210s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:20 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-quobyte-8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e" released by "delete_volume" :: held 1.026s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:21 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] Created reservations ['b4419b16-66f9-4923-99e0-5bffc8368eb4', '748d8939-8eb3-4149-8916-49cca75cd6fc', '5a9af2fb-f101-4b5e-86c6-23551a7fe7af', '4e01e308-51d9-47c2-9952-a287ec22c410'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:30:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.125s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:21 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:30:21 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] Deleted volume successfully. Sep 22 11:30:21 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-74a5ec90-f6c2-4a4d-b967-4f264cc95d4c tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-8f5b5f29-dcb2-4f1f-97d2-fd85c855e84e-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:21 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "cinder-abf86ca9-e012-463a-a0df-5ebe252d2d64-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:21 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-abf86ca9-e012-463a-a0df-5ebe252d2d64-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:22 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "cinder-quobyte-abf86ca9-e012-463a-a0df-5ebe252d2d64" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-quobyte-abf86ca9-e012-463a-a0df-5ebe252d2d64" acquired by "delete_volume" :: waited 0.025s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:22 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bad3840-5e03-4062-a128-f7107e4db885]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:30:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-abf86ca9-e012-463a-a0df-5ebe252d2d64 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-abf86ca9-e012-463a-a0df-5ebe252d2d64" returned: 0 in 0.385s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-abf86ca9-e012-463a-a0df-5ebe252d2d64 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-abf86ca9-e012-463a-a0df-5ebe252d2d64" returned: 0 in 0.101s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-quobyte-abf86ca9-e012-463a-a0df-5ebe252d2d64" released by "delete_volume" :: held 0.664s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:23 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] Created reservations ['5ac1ee97-f661-4eaa-be97-37385b9efd4f', '6b42c0cf-424a-4c39-a104-7e68ec294e82', '13666861-9a23-46b9-a4a2-55425b882a19', 'be788aa0-b5c2-4c98-bc7b-4f95220cf15f'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:30:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.124s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:23 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:30:23 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] Deleted volume successfully. Sep 22 11:30:23 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3a22e20b-ac27-4cd9-9286-4adcaecb076a tempest-CreateVolumesFromImageTest-1012815066 None] Lock "cinder-abf86ca9-e012-463a-a0df-5ebe252d2d64-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:28 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Flow 'volume_create_manager' (294a821c-7f73-40f8-b55a-6df5df4e9b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99469b3-3761-415e-99eb-d2c6c3d12d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99469b3-3761-415e-99eb-d2c6c3d12d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-26880605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ec7c385fa547c3af78acecdd0ecea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:28Z,use_quota=True,user_id='f54d4bedbd3e4e6cbb639845fc050e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e2dd0c-c5c4-4a3a-a0dd-91b3c6428100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e2dd0c-c5c4-4a3a-a0dd-91b3c6428100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153e6b7f-284d-4852-a78c-c80fd4679e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153e6b7f-284d-4852-a78c-c80fd4679e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2', 'volume_name': 'volume-c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6507dbf-534b-4073-bf7b-e6caf5adb898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6507dbf-534b-4073-bf7b-e6caf5adb898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29279d34-6f61-42dc-bff2-9429936ac96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:28 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2', 'volume_size': 1} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-26880605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ec7c385fa547c3af78acecdd0ecea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:28Z,use_quota=True,user_id='f54d4bedbd3e4e6cbb639845fc050e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Creating volume c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:30:28 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:30:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:29 devstack quobyte-client[83313]: System call of process 96843 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:29 devstack quobyte-client[83313]: System call of process 96843 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:29 devstack quobyte-client[83313]: System call of process 96843 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:29 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=124, name=volume-c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:30:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2 1073741824" returned: 0 in 0.772s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2" returned: 0 in 0.137s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] <== create_volume: return (1025ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:30:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29279d34-6f61-42dc-bff2-9429936ac96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f8a6ca-7bed-45d1-82a6-d212d972cc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:30 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume volume-c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2 (c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2): created successfully Sep 22 11:30:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f8a6ca-7bed-45d1-82a6-d212d972cc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:30 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Flow 'volume_create_manager' (294a821c-7f73-40f8-b55a-6df5df4e9b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:30 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-31dc280b-a5e5-45ff-8107-934138d84875 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Created volume successfully. Sep 22 11:30:31 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Flow 'volume_create_manager' (b245e075-e193-431e-8360-5e1d878a82fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e953cac-bf58-4017-8bc2-aab45f734686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e953cac-bf58-4017-8bc2-aab45f734686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1978219789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24111883-2c96-4911-97c1-db167b41b288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ec7c385fa547c3af78acecdd0ecea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:31Z,use_quota=True,user_id='f54d4bedbd3e4e6cbb639845fc050e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ebab7a-4fa9-47c1-9652-87e65c03c023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ebab7a-4fa9-47c1-9652-87e65c03c023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24110982-4ffa-4b7b-8f14-0bd1e9136994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24110982-4ffa-4b7b-8f14-0bd1e9136994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24111883-2c96-4911-97c1-db167b41b288', 'volume_name': 'volume-24111883-2c96-4911-97c1-db167b41b288', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb44840-6eb6-42c9-8105-f52e80130bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb44840-6eb6-42c9-8105-f52e80130bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9057d890-9a38-4ebe-9ea7-903cd009dc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:31 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume 24111883-2c96-4911-97c1-db167b41b288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24111883-2c96-4911-97c1-db167b41b288', 'volume_size': 1} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1978219789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24111883-2c96-4911-97c1-db167b41b288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ec7c385fa547c3af78acecdd0ecea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:31Z,use_quota=True,user_id='f54d4bedbd3e4e6cbb639845fc050e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Creating volume 24111883-2c96-4911-97c1-db167b41b288 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:30:31 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:30:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-24111883-2c96-4911-97c1-db167b41b288 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:31 devstack quobyte-client[83313]: System call of process 96856 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:31 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=125, name=volume-24111883-2c96-4911-97c1-db167b41b288, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:30:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-24111883-2c96-4911-97c1-db167b41b288 1073741824" returned: 0 in 0.845s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-24111883-2c96-4911-97c1-db167b41b288 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:32 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:32 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:30:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Flow 'volume_create_manager' (4cc22cd7-19b2-4a62-806d-8b26fdff970b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c18f63c-02a5-4c02-8451-9528691246a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c18f63c-02a5-4c02-8451-9528691246a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1166890410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3e27f9-55c5-411e-bab5-4da2a26b389a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ec7c385fa547c3af78acecdd0ecea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:32Z,use_quota=True,user_id='f54d4bedbd3e4e6cbb639845fc050e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b033c3-84d3-450b-8094-4f5a3a4b007a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b033c3-84d3-450b-8094-4f5a3a4b007a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984327fb-d6cc-4bab-af00-07e6fb7383e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984327fb-d6cc-4bab-af00-07e6fb7383e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b3e27f9-55c5-411e-bab5-4da2a26b389a', 'volume_name': 'volume-8b3e27f9-55c5-411e-bab5-4da2a26b389a', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1bad02-6dc6-4d0c-985f-105eb756c5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1bad02-6dc6-4d0c-985f-105eb756c5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7974672-72bc-4363-883f-c9b667b3710b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:33 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume 8b3e27f9-55c5-411e-bab5-4da2a26b389a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b3e27f9-55c5-411e-bab5-4da2a26b389a', 'volume_size': 1} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:33 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Flow 'volume_create_manager' (6ced4ef2-067b-4bfa-92a2-343aa3b4b956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd79ce1b-83bb-485b-8314-bbe629cc69e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-24111883-2c96-4911-97c1-db167b41b288" returned: 0 in 0.831s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] <== create_volume: return (1711ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.122s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1166890410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3e27f9-55c5-411e-bab5-4da2a26b389a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ec7c385fa547c3af78acecdd0ecea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:32Z,use_quota=True,user_id='f54d4bedbd3e4e6cbb639845fc050e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Creating volume 8b3e27f9-55c5-411e-bab5-4da2a26b389a {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:30:33 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-8b3e27f9-55c5-411e-bab5-4da2a26b389a 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:33 devstack quobyte-client[83313]: System call of process 96860 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:33 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=126, name=volume-8b3e27f9-55c5-411e-bab5-4da2a26b389a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd79ce1b-83bb-485b-8314-bbe629cc69e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1198889434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b6f4b3-039a-48bf-be2e-41dd54c34d50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ec7c385fa547c3af78acecdd0ecea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:31Z,use_quota=True,user_id='f54d4bedbd3e4e6cbb639845fc050e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e32dd0-c794-497d-83ee-3304208252a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e32dd0-c794-497d-83ee-3304208252a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3f50c4-3024-4ce7-88d0-4ed67934f330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3f50c4-3024-4ce7-88d0-4ed67934f330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5b6f4b3-039a-48bf-be2e-41dd54c34d50', 'volume_name': 'volume-a5b6f4b3-039a-48bf-be2e-41dd54c34d50', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f03e92-5a3d-47e7-a28c-36481bb8f39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f03e92-5a3d-47e7-a28c-36481bb8f39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de41d9ac-7a28-40c9-8c0e-0de60aa1e6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:33 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume a5b6f4b3-039a-48bf-be2e-41dd54c34d50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5b6f4b3-039a-48bf-be2e-41dd54c34d50', 'volume_size': 1} Sep 22 11:30:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:34 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Flow 'volume_create_manager' (0b16f9ee-31df-4df8-9306-0be0a8e6e493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b389de01-4812-447c-b227-e6ee0b4e56bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9057d890-9a38-4ebe-9ea7-903cd009dc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24111883-2c96-4911-97c1-db167b41b288', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d21510-ffb3-4ad9-8088-da594ab6dea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b389de01-4812-447c-b227-e6ee0b4e56bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-176449996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3527a95-f3b5-43b9-a9f6-4c426da51ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ec7c385fa547c3af78acecdd0ecea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:33Z,use_quota=True,user_id='f54d4bedbd3e4e6cbb639845fc050e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1abd3b-2c14-4177-8c1d-865347cce4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1abd3b-2c14-4177-8c1d-865347cce4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e36ed49-7f78-4900-8efd-c0ca53af04f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e36ed49-7f78-4900-8efd-c0ca53af04f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3527a95-f3b5-43b9-a9f6-4c426da51ce4', 'volume_name': 'volume-c3527a95-f3b5-43b9-a9f6-4c426da51ce4', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb962ae0-1828-4833-b36c-2c9d1967ca34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb962ae0-1828-4833-b36c-2c9d1967ca34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99cffabb-ce4d-4803-8c19-545e02444b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:34 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume c3527a95-f3b5-43b9-a9f6-4c426da51ce4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3527a95-f3b5-43b9-a9f6-4c426da51ce4', 'volume_size': 1} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:34 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume volume-24111883-2c96-4911-97c1-db167b41b288 (24111883-2c96-4911-97c1-db167b41b288): created successfully Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d21510-ffb3-4ad9-8088-da594ab6dea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Flow 'volume_create_manager' (b245e075-e193-431e-8360-5e1d878a82fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-8b3e27f9-55c5-411e-bab5-4da2a26b389a 1073741824" returned: 0 in 0.995s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-8b3e27f9-55c5-411e-bab5-4da2a26b389a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:34 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-e5cc118c-8686-4edb-8092-04228b1589d0 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Created volume successfully. Sep 22 11:30:34 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Flow 'volume_create_manager' (2ac535fa-d474-4580-8ae1-6713c7ef5c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f99387b-6254-4d8a-a862-4973981d46ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-8b3e27f9-55c5-411e-bab5-4da2a26b389a" returned: 0 in 0.567s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] <== create_volume: return (1602ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.926s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1198889434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b6f4b3-039a-48bf-be2e-41dd54c34d50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ec7c385fa547c3af78acecdd0ecea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:31Z,use_quota=True,user_id='f54d4bedbd3e4e6cbb639845fc050e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Creating volume a5b6f4b3-039a-48bf-be2e-41dd54c34d50 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:30:34 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:30:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5b6f4b3-039a-48bf-be2e-41dd54c34d50 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:35 devstack quobyte-client[83313]: System call of process 96865 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:35 devstack quobyte-client[83313]: System call of process 96865 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:35 devstack quobyte-client[83313]: System call of process 96865 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:35 devstack quobyte-client[83313]: System call of process 96865 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:35 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=127, name=volume-a5b6f4b3-039a-48bf-be2e-41dd54c34d50, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:30:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f99387b-6254-4d8a-a862-4973981d46ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1053291381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ec7c385fa547c3af78acecdd0ecea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:33Z,use_quota=True,user_id='f54d4bedbd3e4e6cbb639845fc050e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f03a96-1bca-4989-a420-c6f66b4841a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f03a96-1bca-4989-a420-c6f66b4841a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd629c8f-55a6-4bdd-9945-69d9cb2c71a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd629c8f-55a6-4bdd-9945-69d9cb2c71a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b', 'volume_name': 'volume-b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0beed2d4-dd2a-47ff-a090-bcc85f4c4f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0beed2d4-dd2a-47ff-a090-bcc85f4c4f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad9d90a-4c45-49e5-9b7c-16901a323d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:35 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b', 'volume_size': 1} Sep 22 11:30:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7974672-72bc-4363-883f-c9b667b3710b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b3e27f9-55c5-411e-bab5-4da2a26b389a', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7cc14d-9b6b-4dc2-b79b-f9168419499d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5b6f4b3-039a-48bf-be2e-41dd54c34d50 1073741824" returned: 0 in 0.669s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5b6f4b3-039a-48bf-be2e-41dd54c34d50 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:35 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume volume-8b3e27f9-55c5-411e-bab5-4da2a26b389a (8b3e27f9-55c5-411e-bab5-4da2a26b389a): created successfully Sep 22 11:30:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca7cc14d-9b6b-4dc2-b79b-f9168419499d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Flow 'volume_create_manager' (4cc22cd7-19b2-4a62-806d-8b26fdff970b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5b6f4b3-039a-48bf-be2e-41dd54c34d50" returned: 0 in 0.436s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] <== create_volume: return (1141ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:30:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.824s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-176449996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3527a95-f3b5-43b9-a9f6-4c426da51ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ec7c385fa547c3af78acecdd0ecea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:33Z,use_quota=True,user_id='f54d4bedbd3e4e6cbb639845fc050e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:30:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Creating volume c3527a95-f3b5-43b9-a9f6-4c426da51ce4 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:30:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:30:36 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:30:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c3527a95-f3b5-43b9-a9f6-4c426da51ce4 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:36 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-35c4b75f-351a-41e3-b850-d83cd00d7f83 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Created volume successfully. Sep 22 11:30:36 devstack quobyte-client[83313]: System call of process 96869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:36 devstack quobyte-client[83313]: System call of process 96869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:36 devstack quobyte-client[83313]: System call of process 96869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:36 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=128, name=volume-c3527a95-f3b5-43b9-a9f6-4c426da51ce4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:30:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de41d9ac-7a28-40c9-8c0e-0de60aa1e6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5b6f4b3-039a-48bf-be2e-41dd54c34d50', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7fa24bd-96ad-46d9-a4ab-99e0f324c8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c3527a95-f3b5-43b9-a9f6-4c426da51ce4 1073741824" returned: 0 in 0.614s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c3527a95-f3b5-43b9-a9f6-4c426da51ce4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:37 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume volume-a5b6f4b3-039a-48bf-be2e-41dd54c34d50 (a5b6f4b3-039a-48bf-be2e-41dd54c34d50): created successfully Sep 22 11:30:37 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7fa24bd-96ad-46d9-a4ab-99e0f324c8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:37 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Flow 'volume_create_manager' (6ced4ef2-067b-4bfa-92a2-343aa3b4b956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c3527a95-f3b5-43b9-a9f6-4c426da51ce4" returned: 0 in 0.833s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] <== create_volume: return (1491ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:30:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.180s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1053291381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ec7c385fa547c3af78acecdd0ecea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:30:33Z,use_quota=True,user_id='f54d4bedbd3e4e6cbb639845fc050e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:30:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Creating volume b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:30:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:30:37 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:30:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:38 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=129, name=volume-b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:30:38 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-0562e352-d549-48fd-b445-52ad7fb071f9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Created volume successfully. Sep 22 11:30:38 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99cffabb-ce4d-4803-8c19-545e02444b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3527a95-f3b5-43b9-a9f6-4c426da51ce4', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:38 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6d7a46-0a8e-4ef7-bc3f-51a31c561020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:38 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume volume-c3527a95-f3b5-43b9-a9f6-4c426da51ce4 (c3527a95-f3b5-43b9-a9f6-4c426da51ce4): created successfully Sep 22 11:30:38 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6d7a46-0a8e-4ef7-bc3f-51a31c561020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:38 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Flow 'volume_create_manager' (0b16f9ee-31df-4df8-9306-0be0a8e6e493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b 1073741824" returned: 0 in 0.994s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:39 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-5395dd57-eea3-4be4-a473-621b917d964f tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Created volume successfully. Sep 22 11:30:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b" returned: 0 in 0.749s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] <== create_volume: return (1793ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:30:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad9d90a-4c45-49e5-9b7c-16901a323d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1309447-9cb0-4d92-81d2-a5b18897faef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:30:39 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume volume-b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b (b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b): created successfully Sep 22 11:30:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1309447-9cb0-4d92-81d2-a5b18897faef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:30:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Flow 'volume_create_manager' (2ac535fa-d474-4580-8ae1-6713c7ef5c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:30:39 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-11ee4022-f0d7-459d-b9fc-f995604a3af7 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Created volume successfully. Sep 22 11:30:40 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "cinder-b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:40 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:40 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:40 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "cinder-quobyte-b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:40 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-quobyte-b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b" acquired by "delete_volume" :: waited 0.023s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:40 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[02434b90-1f91-48ec-8e0c-a306793d6fe6]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:30:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:41 devstack quobyte-client[83313]: System call of process 96884 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b" returned: 0 in 0.617s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b" returned: 0 in 0.267s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:42 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-quobyte-b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b" released by "delete_volume" :: held 1.279s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:42 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Created reservations ['9c26f80b-4112-4722-984b-64b41f81597d', 'ca233715-fefb-4aed-9557-aeb6d69c279a', '2608b087-477f-4bdd-99cb-3a818142d15e', 'cabd2e94-ee7b-4830-b0cd-a1a9dfa21382'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:30:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:42 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:42 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "cinder-c3527a95-f3b5-43b9-a9f6-4c426da51ce4-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.547s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:43 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:30:43 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Deleted volume successfully. Sep 22 11:30:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-c3527a95-f3b5-43b9-a9f6-4c426da51ce4-delete_volume" acquired by "delete_volume" :: waited 0.299s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2ac2aab0-a5b3-4d8e-88ff-28b6c8ec6854 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-b5bb0d2e-8a71-40d9-92f0-6d5a173a7f3b-delete_volume" released by "delete_volume" :: held 3.120s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:43 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "cinder-quobyte-c3527a95-f3b5-43b9-a9f6-4c426da51ce4" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-quobyte-c3527a95-f3b5-43b9-a9f6-4c426da51ce4" acquired by "delete_volume" :: waited 0.014s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:43 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8901b802-fb68-4d53-89b8-b606c2c3535b]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:30:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c3527a95-f3b5-43b9-a9f6-4c426da51ce4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:44 devstack quobyte-client[83313]: System call of process 96892 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:44 devstack quobyte-client[83313]: System call of process 96892 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:44 devstack quobyte-client[83313]: System call of process 96892 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c3527a95-f3b5-43b9-a9f6-4c426da51ce4" returned: 0 in 0.527s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c3527a95-f3b5-43b9-a9f6-4c426da51ce4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c3527a95-f3b5-43b9-a9f6-4c426da51ce4" returned: 0 in 0.140s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-quobyte-c3527a95-f3b5-43b9-a9f6-4c426da51ce4" released by "delete_volume" :: held 0.893s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:44 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Created reservations ['dca7a623-7fca-42fa-89a8-ef99818bca6d', 'd78772a4-29ae-4553-8049-a93d5c18a909', 'c4b86c92-534b-4ea6-86fa-6b2dd80e9d9e', 'e9dea5af-3393-41ee-9bc1-bea293bd033c'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:30:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:45 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:45 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.148s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:45 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:30:45 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Deleted volume successfully. Sep 22 11:30:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f68e6e06-aef3-4283-b3eb-02162a387f7a tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-c3527a95-f3b5-43b9-a9f6-4c426da51ce4-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "cinder-8b3e27f9-55c5-411e-bab5-4da2a26b389a-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-8b3e27f9-55c5-411e-bab5-4da2a26b389a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:45 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "cinder-quobyte-8b3e27f9-55c5-411e-bab5-4da2a26b389a" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-quobyte-8b3e27f9-55c5-411e-bab5-4da2a26b389a" acquired by "delete_volume" :: waited 0.021s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:46 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cada6cc-04c6-462f-97c3-0a605a4df1be]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:30:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-8b3e27f9-55c5-411e-bab5-4da2a26b389a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:46 devstack quobyte-client[83313]: System call of process 96907 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-8b3e27f9-55c5-411e-bab5-4da2a26b389a" returned: 0 in 0.636s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-8b3e27f9-55c5-411e-bab5-4da2a26b389a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-8b3e27f9-55c5-411e-bab5-4da2a26b389a" returned: 0 in 0.334s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:47 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-quobyte-8b3e27f9-55c5-411e-bab5-4da2a26b389a" released by "delete_volume" :: held 1.299s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:47 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Created reservations ['201f543b-7657-4f12-8487-0cb8b57ad00e', '9866f3f2-aa9a-4fa3-823d-7b12b4f31bba', '816f72d2-3fe3-4c32-9b43-5f5b5e6e3fac', '43b9c0e5-6a9b-4dac-888a-24db6711f9bf'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:30:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.099s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:47 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:30:48 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Deleted volume successfully. Sep 22 11:30:48 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=88,cinder:SELECT=58,cinder:INSERT=19,cinder:DELETE=10 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:30:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "cinder-a5b6f4b3-039a-48bf-be2e-41dd54c34d50-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c245c294-517b-4b00-ad1d-f2117b597289 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-8b3e27f9-55c5-411e-bab5-4da2a26b389a-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-a5b6f4b3-039a-48bf-be2e-41dd54c34d50-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:48 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "cinder-quobyte-a5b6f4b3-039a-48bf-be2e-41dd54c34d50" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-quobyte-a5b6f4b3-039a-48bf-be2e-41dd54c34d50" acquired by "delete_volume" :: waited 0.015s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:48 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bb47ba-1108-436f-b58a-5a0feacbec09]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:30:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5b6f4b3-039a-48bf-be2e-41dd54c34d50 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5b6f4b3-039a-48bf-be2e-41dd54c34d50" returned: 0 in 0.457s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5b6f4b3-039a-48bf-be2e-41dd54c34d50 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5b6f4b3-039a-48bf-be2e-41dd54c34d50" returned: 0 in 0.137s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:49 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-quobyte-a5b6f4b3-039a-48bf-be2e-41dd54c34d50" released by "delete_volume" :: held 0.766s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:49 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Created reservations ['0e748930-8088-4b43-a00f-948a956dcafb', '00327cce-4dd8-4917-89f6-ac8493b80d42', '465934b6-cc53-494b-90ab-31183d618e0e', 'ca8cdf09-8a94-4067-9b70-42d16de3b1af'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:30:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.109s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:49 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:30:49 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Deleted volume successfully. Sep 22 11:30:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-b4342d02-9323-4eeb-9a0d-54eff80abf71 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-a5b6f4b3-039a-48bf-be2e-41dd54c34d50-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "cinder-24111883-2c96-4911-97c1-db167b41b288-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-24111883-2c96-4911-97c1-db167b41b288-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:50 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "cinder-quobyte-24111883-2c96-4911-97c1-db167b41b288" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-quobyte-24111883-2c96-4911-97c1-db167b41b288" acquired by "delete_volume" :: waited 0.011s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:50 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[942fb00c-40fd-45f9-9d71-81f4c7363456]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:30:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-24111883-2c96-4911-97c1-db167b41b288 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:51 devstack quobyte-client[83313]: System call of process 96940 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:30:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-24111883-2c96-4911-97c1-db167b41b288" returned: 0 in 0.547s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-24111883-2c96-4911-97c1-db167b41b288 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-24111883-2c96-4911-97c1-db167b41b288" returned: 0 in 0.138s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:51 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-quobyte-24111883-2c96-4911-97c1-db167b41b288" released by "delete_volume" :: held 0.879s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:52 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Created reservations ['755118e4-0ca5-4875-80af-0d736f97b859', '70173252-a9be-4b2a-bac6-a13584a4c758', '6859c64a-0287-4e7a-8c54-2cd09a3ae357', '7b5482c8-430a-42a2-b2a7-422252b01bb3'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:30:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.117s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:52 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:30:52 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Deleted volume successfully. Sep 22 11:30:52 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-40698655-ba63-49c1-9d9f-766a75f7b436 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-24111883-2c96-4911-97c1-db167b41b288-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:53 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "cinder-c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:53 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:53 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:30:53 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "cinder-quobyte-c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:30:53 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-quobyte-c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2" acquired by "delete_volume" :: waited 0.010s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:30:53 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2856bbd2-03da-48fd-a9b6-f3fa99bdecae]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:30:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2" returned: 0 in 0.497s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2" returned: 0 in 0.127s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-quobyte-c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2" released by "delete_volume" :: held 0.836s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:30:54 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Created reservations ['5dfa4401-c4c3-47a2-8748-4af07aba8334', '89fc06f4-02b6-48e9-9c11-d8b91a006103', 'd1b602ed-155d-49e0-ae6c-efc2c9773922', 'fde9f8f7-fe30-4b75-b80c-b373777dab80'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:30:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:30:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:30:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:30:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:30:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:30:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:30:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.142s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:30:54 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:30:55 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Deleted volume successfully. Sep 22 11:30:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-88751ae3-0aa2-4a45-95f7-e080335e77c9 tempest-CreateVolumesFromSourceVolumeTest-9197809 None] Lock "cinder-c6d7b12f-2fa6-42c6-a05b-2fdeda320fa2-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:31:04 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=17,cinder:INSERT=2,cinder:UPDATE=38,cinder:DELETE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:31:05 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=68,cinder:UPDATE=111,cinder:INSERT=27,cinder:DELETE=12 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:31:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:31:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:31:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:31:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:31:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:31:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:31:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:31:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.118s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:31:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:31:44 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Flow 'volume_create_manager' (69e3412e-701e-4bea-8be3-79fbbca15505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c66e9a3-f7f9-4a85-863a-bd806b3d8475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c66e9a3-f7f9-4a85-863a-bd806b3d8475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1665366903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071073f5-d673-44c1-bfbe-8f38aa1b6847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1401de849a46b7923b8c921902721c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:31:44Z,use_quota=True,user_id='af070344e2c648ad9095455367555ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9960319-612c-475c-816b-6cd7146376c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9960319-612c-475c-816b-6cd7146376c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d3838e-dcbb-4259-bd8f-7ee7fdf32359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d3838e-dcbb-4259-bd8f-7ee7fdf32359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '071073f5-d673-44c1-bfbe-8f38aa1b6847', 'volume_name': 'volume-071073f5-d673-44c1-bfbe-8f38aa1b6847', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a7ee50-10f6-48d1-812c-bbc2faf545cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a7ee50-10f6-48d1-812c-bbc2faf545cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07115250-206d-4405-9c53-8687f2d26a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:31:44 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Volume 071073f5-d673-44c1-bfbe-8f38aa1b6847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-071073f5-d673-44c1-bfbe-8f38aa1b6847', 'volume_size': 1} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1665366903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071073f5-d673-44c1-bfbe-8f38aa1b6847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e1401de849a46b7923b8c921902721c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:31:44Z,use_quota=True,user_id='af070344e2c648ad9095455367555ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Creating volume 071073f5-d673-44c1-bfbe-8f38aa1b6847 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:31:44 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-071073f5-d673-44c1-bfbe-8f38aa1b6847 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:31:44 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=130, name=volume-071073f5-d673-44c1-bfbe-8f38aa1b6847, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-071073f5-d673-44c1-bfbe-8f38aa1b6847 1073741824" returned: 0 in 0.359s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-071073f5-d673-44c1-bfbe-8f38aa1b6847 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-071073f5-d673-44c1-bfbe-8f38aa1b6847" returned: 0 in 0.129s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] <== create_volume: return (573ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:31:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.590s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:31:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07115250-206d-4405-9c53-8687f2d26a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-071073f5-d673-44c1-bfbe-8f38aa1b6847', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:31:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b55c63-2046-4d99-8a50-b1474cfd9567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:31:45 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Volume volume-071073f5-d673-44c1-bfbe-8f38aa1b6847 (071073f5-d673-44c1-bfbe-8f38aa1b6847): created successfully Sep 22 11:31:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b55c63-2046-4d99-8a50-b1474cfd9567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:31:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Flow 'volume_create_manager' (69e3412e-701e-4bea-8be3-79fbbca15505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:31:45 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-d05f697f-2d99-47a8-856d-2c97a6b9a33f tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Created volume successfully. Sep 22 11:31:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-8ad67c26-6811-477d-9bcc-b0f71ec029ca req-d0917ac3-9366-474c-8af5-c641734d220e tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:31:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-8ad67c26-6811-477d-9bcc-b0f71ec029ca req-d0917ac3-9366-474c-8af5-c641734d220e tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:31:49 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[282d9aca-bbfb-4697-9980-0436b090a28c]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:31:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-8ad67c26-6811-477d-9bcc-b0f71ec029ca req-d0917ac3-9366-474c-8af5-c641734d220e tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-071073f5-d673-44c1-bfbe-8f38aa1b6847 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:31:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-8ad67c26-6811-477d-9bcc-b0f71ec029ca req-d0917ac3-9366-474c-8af5-c641734d220e tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-071073f5-d673-44c1-bfbe-8f38aa1b6847" returned: 0 in 0.402s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:31:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-8ad67c26-6811-477d-9bcc-b0f71ec029ca req-d0917ac3-9366-474c-8af5-c641734d220e tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.460s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:31:50 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-8ad67c26-6811-477d-9bcc-b0f71ec029ca req-d0917ac3-9366-474c-8af5-c641734d220e tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-071073f5-d673-44c1-bfbe-8f38aa1b6847', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d3e87ba-0340-48d3-b412-4b22c26498a6', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:31:50 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-8ad67c26-6811-477d-9bcc-b0f71ec029ca req-d0917ac3-9366-474c-8af5-c641734d220e tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:31:50 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-8ad67c26-6811-477d-9bcc-b0f71ec029ca req-d0917ac3-9366-474c-8af5-c641734d220e tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] attachment_update completed successfully. Sep 22 11:32:08 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:32:08 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=6,cinder:SELECT=8 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:32:20 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-509f7f13-e390-442d-bbf3-82dc0a24b474 req-9addcaae-cd43-4d37-af7e-09e3f7ac35b6 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:32:20 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-509f7f13-e390-442d-bbf3-82dc0a24b474 req-9addcaae-cd43-4d37-af7e-09e3f7ac35b6 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:32:20 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-509f7f13-e390-442d-bbf3-82dc0a24b474 req-9addcaae-cd43-4d37-af7e-09e3f7ac35b6 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Terminate volume connection completed successfully. Sep 22 11:32:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-509f7f13-e390-442d-bbf3-82dc0a24b474 req-9addcaae-cd43-4d37-af7e-09e3f7ac35b6 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Deleting attachment 7d3e87ba-0340-48d3-b412-4b22c26498a6. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:32:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Acquiring lock "cinder-071073f5-d673-44c1-bfbe-8f38aa1b6847-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:32:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Lock "cinder-071073f5-d673-44c1-bfbe-8f38aa1b6847-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:32:22 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:32:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Acquiring lock "cinder-quobyte-071073f5-d673-44c1-bfbe-8f38aa1b6847" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:32:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Lock "cinder-quobyte-071073f5-d673-44c1-bfbe-8f38aa1b6847" acquired by "delete_volume" :: waited 0.018s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:32:22 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[aababa47-0046-457d-9eb2-6b071be2cf20]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:32:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-071073f5-d673-44c1-bfbe-8f38aa1b6847 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:32:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-071073f5-d673-44c1-bfbe-8f38aa1b6847" returned: 0 in 0.414s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:32:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-071073f5-d673-44c1-bfbe-8f38aa1b6847 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:32:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-071073f5-d673-44c1-bfbe-8f38aa1b6847" returned: 0 in 0.106s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:32:23 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Lock "cinder-quobyte-071073f5-d673-44c1-bfbe-8f38aa1b6847" released by "delete_volume" :: held 0.674s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:32:23 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Created reservations ['43c6f9a7-0cdf-4c1d-b6d9-4e6ae2a12f98', 'bd03f7cf-8317-4629-b196-5f49a07330e9', 'b1431348-43d9-4b61-b849-ba2aabcae5a6', '4c812029-4019-4cf8-bfd7-dbc629c62fad'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:32:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:32:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:32:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:32:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:32:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:32:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:32:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.086s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:32:23 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:32:23 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Deleted volume successfully. Sep 22 11:32:23 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-88a79eb5-3d4a-444d-8ce4-801ddbc52224 tempest-TestServerVolumeAttachScenarioOldVersion-680927690 None] Lock "cinder-071073f5-d673-44c1-bfbe-8f38aa1b6847-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:32:33 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=9 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:32:33 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:33:10 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Flow 'volume_create_manager' (613cdf69-77c4-40a7-8fe9-20e10185738a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843a047d-3271-4515-b35e-2550bd369213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843a047d-3271-4515-b35e-2550bd369213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1166983155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130e80e7-6fb3-40ba-8422-963a59ce3f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03b700c2e98459e896b77068d3633ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:33:10Z,use_quota=True,user_id='c957ab3591a1440999686906092eebe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0c1f4b-46e4-48df-b00a-04cf84c2bdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0c1f4b-46e4-48df-b00a-04cf84c2bdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e58d63-bd0c-4020-9384-c2a30a3241ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e58d63-bd0c-4020-9384-c2a30a3241ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '130e80e7-6fb3-40ba-8422-963a59ce3f18', 'volume_name': 'volume-130e80e7-6fb3-40ba-8422-963a59ce3f18', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e469c30-6da7-4377-98b5-500569c128ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e469c30-6da7-4377-98b5-500569c128ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217a2d4b-2734-4a9b-9b14-efe3210178c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:33:10 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Volume 130e80e7-6fb3-40ba-8422-963a59ce3f18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-130e80e7-6fb3-40ba-8422-963a59ce3f18', 'volume_size': 1} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1166983155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130e80e7-6fb3-40ba-8422-963a59ce3f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03b700c2e98459e896b77068d3633ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:33:10Z,use_quota=True,user_id='c957ab3591a1440999686906092eebe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Creating volume 130e80e7-6fb3-40ba-8422-963a59ce3f18 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:33:10 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-130e80e7-6fb3-40ba-8422-963a59ce3f18 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:33:10 devstack quobyte-client[83313]: System call of process 97591 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:33:10 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=131, name=volume-130e80e7-6fb3-40ba-8422-963a59ce3f18, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:33:10 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Flow 'volume_create_manager' (b99d11d6-ea6a-4371-b31b-7e43aba2ae3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:33:10 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb3b0b5-a60f-43a6-9aed-0fca0d2cc7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-130e80e7-6fb3-40ba-8422-963a59ce3f18 1073741824" returned: 0 in 0.676s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-130e80e7-6fb3-40ba-8422-963a59ce3f18 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb3b0b5-a60f-43a6-9aed-0fca0d2cc7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-663299613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3d54a9-7e67-43ea-80b7-2d52cae8b448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03b700c2e98459e896b77068d3633ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:33:10Z,use_quota=True,user_id='c957ab3591a1440999686906092eebe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9483793-a185-4e90-83a8-39940e51cf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9483793-a185-4e90-83a8-39940e51cf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20bea57d-fd41-49a1-b9cc-cfc8c086cd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20bea57d-fd41-49a1-b9cc-cfc8c086cd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa3d54a9-7e67-43ea-80b7-2d52cae8b448', 'volume_name': 'volume-fa3d54a9-7e67-43ea-80b7-2d52cae8b448', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2adfc46e-3c17-45c8-ae3c-f23cddb39925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2adfc46e-3c17-45c8-ae3c-f23cddb39925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3870fd46-96ec-4a09-8a2b-f6708c0bccb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:33:11 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Volume fa3d54a9-7e67-43ea-80b7-2d52cae8b448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa3d54a9-7e67-43ea-80b7-2d52cae8b448', 'volume_size': 1} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-130e80e7-6fb3-40ba-8422-963a59ce3f18" returned: 0 in 0.395s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] <== create_volume: return (1090ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.068s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-663299613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3d54a9-7e67-43ea-80b7-2d52cae8b448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03b700c2e98459e896b77068d3633ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:33:10Z,use_quota=True,user_id='c957ab3591a1440999686906092eebe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Creating volume fa3d54a9-7e67-43ea-80b7-2d52cae8b448 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:33:11 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa3d54a9-7e67-43ea-80b7-2d52cae8b448 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:33:11 devstack quobyte-client[83313]: System call of process 97595 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:33:11 devstack quobyte-client[83313]: System call of process 97595 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:33:11 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=132, name=volume-fa3d54a9-7e67-43ea-80b7-2d52cae8b448, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217a2d4b-2734-4a9b-9b14-efe3210178c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-130e80e7-6fb3-40ba-8422-963a59ce3f18', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd27639d-ac4f-425d-8c12-c50e3577c18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa3d54a9-7e67-43ea-80b7-2d52cae8b448 1073741824" returned: 0 in 0.464s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:33:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa3d54a9-7e67-43ea-80b7-2d52cae8b448 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:33:12 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Volume volume-130e80e7-6fb3-40ba-8422-963a59ce3f18 (130e80e7-6fb3-40ba-8422-963a59ce3f18): created successfully Sep 22 11:33:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd27639d-ac4f-425d-8c12-c50e3577c18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:33:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Flow 'volume_create_manager' (613cdf69-77c4-40a7-8fe9-20e10185738a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:33:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa3d54a9-7e67-43ea-80b7-2d52cae8b448" returned: 0 in 0.358s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:33:12 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] <== create_volume: return (843ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:33:12 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:33:12 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-36004814-31d3-4d6a-886f-16dc81e18386 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Created volume successfully. Sep 22 11:33:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3870fd46-96ec-4a09-8a2b-f6708c0bccb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa3d54a9-7e67-43ea-80b7-2d52cae8b448', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:33:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2b97e3-e281-454e-8754-e371056e2fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:33:12 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Volume volume-fa3d54a9-7e67-43ea-80b7-2d52cae8b448 (fa3d54a9-7e67-43ea-80b7-2d52cae8b448): created successfully Sep 22 11:33:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2b97e3-e281-454e-8754-e371056e2fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:33:12 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Flow 'volume_create_manager' (b99d11d6-ea6a-4371-b31b-7e43aba2ae3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:33:12 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-e2e2062e-170a-4f3e-85df-75f60ff94432 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Created volume successfully. Sep 22 11:33:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:33:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:33:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:33:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:33:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:33:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:33:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:33:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.090s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:33:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:33:22 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=6,cinder:SELECT=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:33:22 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:34:08 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:34:08 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:34:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:34:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:34:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:34:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:34:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:34:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:34:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:34:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.112s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:34:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:34:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-bb6dafeb-33a2-4dec-8a17-a06ed72ba17a req-68d7597a-6719-44cd-bd01-bd235675bad7 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:34:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-bb6dafeb-33a2-4dec-8a17-a06ed72ba17a req-68d7597a-6719-44cd-bd01-bd235675bad7 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:34:47 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1278b08-2c45-4b2b-aeab-f7862c1923d3]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:34:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-bb6dafeb-33a2-4dec-8a17-a06ed72ba17a req-68d7597a-6719-44cd-bd01-bd235675bad7 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-130e80e7-6fb3-40ba-8422-963a59ce3f18 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:34:47 devstack quobyte-client[83313]: System call of process 97818 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:34:47 devstack quobyte-client[83313]: System call of process 97818 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:34:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-bb6dafeb-33a2-4dec-8a17-a06ed72ba17a req-68d7597a-6719-44cd-bd01-bd235675bad7 tempest-TestServerVolumeAttachmentScenario-2052739311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-130e80e7-6fb3-40ba-8422-963a59ce3f18" returned: 0 in 0.629s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:34:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-bb6dafeb-33a2-4dec-8a17-a06ed72ba17a req-68d7597a-6719-44cd-bd01-bd235675bad7 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.693s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:34:48 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-bb6dafeb-33a2-4dec-8a17-a06ed72ba17a req-68d7597a-6719-44cd-bd01-bd235675bad7 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-130e80e7-6fb3-40ba-8422-963a59ce3f18', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b7f0ad1-2887-47e1-9957-c3f5bce6278a', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:34:48 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-bb6dafeb-33a2-4dec-8a17-a06ed72ba17a req-68d7597a-6719-44cd-bd01-bd235675bad7 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:34:48 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-bb6dafeb-33a2-4dec-8a17-a06ed72ba17a req-68d7597a-6719-44cd-bd01-bd235675bad7 tempest-TestServerVolumeAttachmentScenario-2052739311 None] attachment_update completed successfully. Sep 22 11:34:58 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:34:58 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:35:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-d666740c-47bf-4043-a0eb-45afabd1b763 req-aa196c79-3aae-4af7-b2cf-16a78bc5f919 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:35:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-d666740c-47bf-4043-a0eb-45afabd1b763 req-aa196c79-3aae-4af7-b2cf-16a78bc5f919 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:35:00 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d941b83-c553-42cd-bd88-280111b0c355]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:35:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-d666740c-47bf-4043-a0eb-45afabd1b763 req-aa196c79-3aae-4af7-b2cf-16a78bc5f919 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa3d54a9-7e67-43ea-80b7-2d52cae8b448 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:35:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-d666740c-47bf-4043-a0eb-45afabd1b763 req-aa196c79-3aae-4af7-b2cf-16a78bc5f919 tempest-TestServerVolumeAttachmentScenario-2052739311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa3d54a9-7e67-43ea-80b7-2d52cae8b448" returned: 0 in 0.412s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:35:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-d666740c-47bf-4043-a0eb-45afabd1b763 req-aa196c79-3aae-4af7-b2cf-16a78bc5f919 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.489s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:35:01 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-d666740c-47bf-4043-a0eb-45afabd1b763 req-aa196c79-3aae-4af7-b2cf-16a78bc5f919 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-fa3d54a9-7e67-43ea-80b7-2d52cae8b448', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc989f84-9d05-4ff0-8204-d1f51379217e', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:35:01 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-d666740c-47bf-4043-a0eb-45afabd1b763 req-aa196c79-3aae-4af7-b2cf-16a78bc5f919 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:35:01 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-d666740c-47bf-4043-a0eb-45afabd1b763 req-aa196c79-3aae-4af7-b2cf-16a78bc5f919 tempest-TestServerVolumeAttachmentScenario-2052739311 None] attachment_update completed successfully. Sep 22 11:35:11 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:35:11 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:35:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:35:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:35:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:35:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:35:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:35:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:35:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:35:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.089s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:35:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:35:29 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-e2366376-357a-40bd-8935-2d051c066e53 req-3a3ee43b-186a-4d60-913c-ee5122f1cdbb tempest-TestServerVolumeAttachmentScenario-2052739311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:35:29 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-e2366376-357a-40bd-8935-2d051c066e53 req-3a3ee43b-186a-4d60-913c-ee5122f1cdbb tempest-TestServerVolumeAttachmentScenario-2052739311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:35:29 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-e2366376-357a-40bd-8935-2d051c066e53 req-3a3ee43b-186a-4d60-913c-ee5122f1cdbb tempest-TestServerVolumeAttachmentScenario-2052739311 None] Terminate volume connection completed successfully. Sep 22 11:35:29 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-e2366376-357a-40bd-8935-2d051c066e53 req-3a3ee43b-186a-4d60-913c-ee5122f1cdbb tempest-TestServerVolumeAttachmentScenario-2052739311 None] Deleting attachment fc989f84-9d05-4ff0-8204-d1f51379217e. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:35:39 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:35:52 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-b610e1cd-334a-4729-8d5c-0e429f831cf6 req-f2d069d1-6077-4b62-b006-4790dfd75e65 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:35:52 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-b610e1cd-334a-4729-8d5c-0e429f831cf6 req-f2d069d1-6077-4b62-b006-4790dfd75e65 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:35:52 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-b610e1cd-334a-4729-8d5c-0e429f831cf6 req-f2d069d1-6077-4b62-b006-4790dfd75e65 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Terminate volume connection completed successfully. Sep 22 11:35:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-b610e1cd-334a-4729-8d5c-0e429f831cf6 req-f2d069d1-6077-4b62-b006-4790dfd75e65 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Deleting attachment 5b7f0ad1-2887-47e1-9957-c3f5bce6278a. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:36:02 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:36:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] Acquiring lock "cinder-fa3d54a9-7e67-43ea-80b7-2d52cae8b448-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:36:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "cinder-fa3d54a9-7e67-43ea-80b7-2d52cae8b448-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:36:03 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:36:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] Acquiring lock "cinder-quobyte-fa3d54a9-7e67-43ea-80b7-2d52cae8b448" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:36:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "cinder-quobyte-fa3d54a9-7e67-43ea-80b7-2d52cae8b448" acquired by "delete_volume" :: waited 0.014s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:36:03 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[900a344c-fa50-4035-a688-278cdf75124b]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:36:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa3d54a9-7e67-43ea-80b7-2d52cae8b448 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:36:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa3d54a9-7e67-43ea-80b7-2d52cae8b448" returned: 0 in 0.406s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:36:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa3d54a9-7e67-43ea-80b7-2d52cae8b448 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:36:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fa3d54a9-7e67-43ea-80b7-2d52cae8b448" returned: 0 in 0.123s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:36:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "cinder-quobyte-fa3d54a9-7e67-43ea-80b7-2d52cae8b448" released by "delete_volume" :: held 0.692s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:36:04 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] Created reservations ['a659cafc-bc36-4754-bbc2-c3785a39e6f1', '7e616d15-5a6d-41a9-a876-21acba816d84', 'd8b7c2a3-d999-4829-adc3-7a3f88f33d00', '6771af17-108b-4b19-81ca-63f908446adb'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:36:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:36:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:36:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:36:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:36:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:36:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:36:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.084s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:36:05 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:36:05 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] Deleted volume successfully. Sep 22 11:36:05 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f1c61789-c28e-4952-b5ba-20a4be12915b tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "cinder-fa3d54a9-7e67-43ea-80b7-2d52cae8b448-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:36:05 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Acquiring lock "cinder-130e80e7-6fb3-40ba-8422-963a59ce3f18-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:36:05 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "cinder-130e80e7-6fb3-40ba-8422-963a59ce3f18-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:36:06 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:36:06 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Acquiring lock "cinder-quobyte-130e80e7-6fb3-40ba-8422-963a59ce3f18" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:36:06 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "cinder-quobyte-130e80e7-6fb3-40ba-8422-963a59ce3f18" acquired by "delete_volume" :: waited 0.016s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:36:06 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[81969ead-f9f1-46c3-a969-a8d4a1103a39]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:36:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-130e80e7-6fb3-40ba-8422-963a59ce3f18 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:36:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-130e80e7-6fb3-40ba-8422-963a59ce3f18" returned: 0 in 0.405s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:36:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-130e80e7-6fb3-40ba-8422-963a59ce3f18 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:36:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-130e80e7-6fb3-40ba-8422-963a59ce3f18" returned: 0 in 0.099s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:36:06 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "cinder-quobyte-130e80e7-6fb3-40ba-8422-963a59ce3f18" released by "delete_volume" :: held 0.688s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:36:07 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Created reservations ['f2b5d778-ed67-4b6f-96af-65ab591839be', '7e7e6de1-6660-4384-b020-10954ab0c59c', 'c01cb36a-0f57-40cd-a771-af1c8864b9f0', '7b8338fb-8ffe-47ac-8ad2-794e0b541592'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:36:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:36:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:36:07 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:36:07 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:36:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:36:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:36:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.084s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:36:07 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:36:07 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Deleted volume successfully. Sep 22 11:36:07 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fafff73f-fc3f-43ac-86a0-95cf10bd2f68 tempest-TestServerVolumeAttachmentScenario-2052739311 None] Lock "cinder-130e80e7-6fb3-40ba-8422-963a59ce3f18-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:36:17 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=8,cinder:UPDATE=19,cinder:INSERT=5 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:36:17 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=14,cinder:INSERT=3,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:36:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:36:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:36:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:36:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:36:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:36:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:36:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:36:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.145s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:36:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:36:43 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:36:43 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:36:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Flow 'volume_create_manager' (0d335e59-770b-4a93-9eab-1af88c80ae01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:36:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (316b756c-4ab4-4129-a180-e761bc027dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:36:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (316b756c-4ab4-4129-a180-e761bc027dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1510915565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3762c687f1b54b0dac711c2894651156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:36:43Z,use_quota=True,user_id='5ef384db37d844ce8f4c0a61da08076a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:36:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da76ac5a-4f6e-457e-a677-5b11ec129411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:36:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da76ac5a-4f6e-457e-a677-5b11ec129411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:36:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3bf822-8fe9-4e5d-a9aa-c1d4ba0431fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:36:43 devstack cinder-volume[83310]: DEBUG cinder.image.glance [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Creating Keystone auth plugin from conf {{(pid=83310) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 22 11:36:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3bf822-8fe9-4e5d-a9aa-c1d4ba0431fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9', 'volume_name': 'volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9', 'volume_size': 1, 'image_id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a739f36f4ea4c5eb46d43587eb0544d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'created_at': datetime.datetime(2025, 9, 22, 8, 49, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 8, 49, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a1d9109-49e8-406b-a105-f8fc540ab994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:36:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9de5f7-8de4-49a5-a2d2-e86aa1fe4622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:36:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9de5f7-8de4-49a5-a2d2-e86aa1fe4622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:36:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9428fb8-005b-42a5-bae6-4fed105aab10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:36:44 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Volume f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9', 'volume_size': 1, 'image_id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a739f36f4ea4c5eb46d43587eb0544d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'created_at': datetime.datetime(2025, 9, 22, 8, 49, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 8, 49, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a1d9109-49e8-406b-a105-f8fc540ab994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 22 11:36:44 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Cloning f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 from image 1a1d9109-49e8-406b-a105-f8fc540ab994 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}]). {{(pid=83310) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 22 11:36:44 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_l3yej0cpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 22 11:36:44 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Image download 20.69 MB at 20.69 MB/s Sep 22 11:36:44 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c2a32a-56c5-402a-aa48-bf5a44b4b31c]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:36:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_l3yej0cpdevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:36:45 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_l3yej0cpdevstack@QuobyteHD Sep 22 11:36:45 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 11:36:46 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Sep 22 11:36:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_l3yej0cpdevstack@QuobyteHD" returned: 0 in 2.301s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:36:46 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Temporary image 1a1d9109-49e8-406b-a105-f8fc540ab994 is fetched for user 5ef384db37d844ce8f4c0a61da08076a. {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 22 11:36:47 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[154b6a21-bac8-430b-bb9c-62e8c41be28d]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:36:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_l3yej0cpdevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:36:47 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_l3yej0cpdevstack@QuobyteHD Sep 22 11:36:47 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 11:36:49 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Sep 22 11:36:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_l3yej0cpdevstack@QuobyteHD" returned: 0 in 2.049s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:36:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:36:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:36:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1510915565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3762c687f1b54b0dac711c2894651156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:36:43Z,use_quota=True,user_id='5ef384db37d844ce8f4c0a61da08076a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:36:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Creating volume f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:36:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:36:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:36:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:36:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:36:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:36:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:36:49 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:36:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:36:49 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=133, name=volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:36:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 1073741824" returned: 0 in 0.332s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:36:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:36:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9" returned: 0 in 0.098s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:36:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] <== create_volume: return (530ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:36:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.563s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:36:50 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Attempting download of 1a1d9109-49e8-406b-a105-f8fc540ab994 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}])) to volume f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9. {{(pid=83310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 22 11:36:50 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[04223e2a-9876-4145-be54-22df8d4ea17f]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:36:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_5ky8dj5c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:36:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_5ky8dj5c" returned: 0 in 0.349s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:36:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_5ky8dj5c {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:36:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_5ky8dj5c" returned: 1 in 0.367s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:36:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a1d9109-49e8-406b-a105-f8fc540ab994_5ky8dj5c' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:36:51 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3ee821-8227-4a22-8774-f2384451dd44]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:36:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_l3yej0cpdevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:36:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_l3yej0cpdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:36:51 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] 1a1d9109-49e8-406b-a105-f8fc540ab994 was qcow2, converting to raw {{(pid=83310) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 22 11:36:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_l3yej0cpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:36:51 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=133, name=volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:36:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_l3yej0cpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9" returned: 0 in 1.035s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:36:52 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1a1d9109-49e8-406b-a105-f8fc540ab994_l3yej0cpdevstack@QuobyteHD, size 112.00 MB, duration 1.06 sec, destination /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 {{(pid=83310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 22 11:36:52 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Converted 112.00 MB image at 105.49 MB/s Sep 22 11:36:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:36:52 devstack quobyte-client[83313]: System call of process 98471 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:36:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 1G" returned: 0 in 0.134s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:36:52 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec66805-5b18-4943-ad2d-e8b7b31a0bbd]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:36:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:36:53 devstack quobyte-client[83313]: System call of process 98483 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:36:53 devstack quobyte-client[83313]: System call of process 98483 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:36:53 devstack quobyte-client[83313]: System call of process 98483 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:36:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9" returned: 0 in 0.519s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:36:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:36:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9" returned: 1 in 0.455s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:36:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:36:53 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Downloaded image 1a1d9109-49e8-406b-a105-f8fc540ab994 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}])) to volume f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 successfully. {{(pid=83310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 22 11:36:53 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Temporary image 1a1d9109-49e8-406b-a105-f8fc540ab994 for user 5ef384db37d844ce8f4c0a61da08076a is deleted. {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 22 11:36:53 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Marking volume f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 as bootable. {{(pid=83310) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 22 11:36:54 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Copying metadata from image 1a1d9109-49e8-406b-a105-f8fc540ab994 to f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9. {{(pid=83310) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 11:36:54 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Creating volume glance metadata for volume f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 backed by image 1a1d9109-49e8-406b-a105-f8fc540ab994 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83310) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 11:36:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9428fb8-005b-42a5-bae6-4fed105aab10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9', 'volume_size': 1, 'image_id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a1d9109-49e8-406b-a105-f8fc540ab994', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2a739f36f4ea4c5eb46d43587eb0544d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a1d9109-49e8-406b-a105-f8fc540ab994', 'created_at': datetime.datetime(2025, 9, 22, 8, 49, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 8, 49, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a1d9109-49e8-406b-a105-f8fc540ab994/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:36:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42852742-dbe0-4e5e-99d4-e761bd123685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:36:54 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Volume volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 (f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9): created successfully Sep 22 11:36:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42852742-dbe0-4e5e-99d4-e761bd123685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:36:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Flow 'volume_create_manager' (0d335e59-770b-4a93-9eab-1af88c80ae01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:36:54 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-2c658aee-b64e-46a5-ace5-522b3854fe8f tempest-TestShelveInstance-1099580978 None] Created volume successfully. Sep 22 11:37:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-cf153f43-a4e3-41af-8bff-8668f5cf072d req-33a63a61-47a8-48ec-a116-707bc29e355d tempest-TestShelveInstance-1099580978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:37:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-cf153f43-a4e3-41af-8bff-8668f5cf072d req-33a63a61-47a8-48ec-a116-707bc29e355d tempest-TestShelveInstance-1099580978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:37:04 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b1ae68-e116-4fa0-8d24-d69ae3815eec]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:37:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-cf153f43-a4e3-41af-8bff-8668f5cf072d req-33a63a61-47a8-48ec-a116-707bc29e355d tempest-TestShelveInstance-1099580978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:37:04 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=16,cinder:UPDATE=3,cinder:INSERT=10,cinder:DELETE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:37:04 devstack quobyte-client[83313]: System call of process 98528 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:37:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-cf153f43-a4e3-41af-8bff-8668f5cf072d req-33a63a61-47a8-48ec-a116-707bc29e355d tempest-TestShelveInstance-1099580978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9" returned: 0 in 0.472s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:37:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-cf153f43-a4e3-41af-8bff-8668f5cf072d req-33a63a61-47a8-48ec-a116-707bc29e355d tempest-TestShelveInstance-1099580978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:37:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-cf153f43-a4e3-41af-8bff-8668f5cf072d req-33a63a61-47a8-48ec-a116-707bc29e355d tempest-TestShelveInstance-1099580978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9" returned: 1 in 0.414s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:37:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-cf153f43-a4e3-41af-8bff-8668f5cf072d req-33a63a61-47a8-48ec-a116-707bc29e355d tempest-TestShelveInstance-1099580978 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:37:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-cf153f43-a4e3-41af-8bff-8668f5cf072d req-33a63a61-47a8-48ec-a116-707bc29e355d tempest-TestShelveInstance-1099580978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.977s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:37:05 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-cf153f43-a4e3-41af-8bff-8668f5cf072d req-33a63a61-47a8-48ec-a116-707bc29e355d tempest-TestShelveInstance-1099580978 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4533e21-61a5-4863-9c31-371802cabffb', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:37:05 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-cf153f43-a4e3-41af-8bff-8668f5cf072d req-33a63a61-47a8-48ec-a116-707bc29e355d tempest-TestShelveInstance-1099580978 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:37:05 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-cf153f43-a4e3-41af-8bff-8668f5cf072d req-33a63a61-47a8-48ec-a116-707bc29e355d tempest-TestShelveInstance-1099580978 None] attachment_update completed successfully. Sep 22 11:37:15 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=7,cinder:INSERT=3,cinder:SELECT=6 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:37:15 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=6 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:37:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:37:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:37:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:37:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:37:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:37:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:37:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:37:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.118s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:37:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:38:08 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:38:08 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:38:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:38:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:38:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:38:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:38:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:38:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:38:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:38:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.096s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:38:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:38:37 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-7448d982-d05a-4b80-b295-aa7cdc3cd8d5 req-12493634-8060-4927-a516-e8ca63bf6246 tempest-TestShelveInstance-1099580978 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:38:37 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-7448d982-d05a-4b80-b295-aa7cdc3cd8d5 req-12493634-8060-4927-a516-e8ca63bf6246 tempest-TestShelveInstance-1099580978 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:38:37 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-7448d982-d05a-4b80-b295-aa7cdc3cd8d5 req-12493634-8060-4927-a516-e8ca63bf6246 tempest-TestShelveInstance-1099580978 None] Terminate volume connection completed successfully. Sep 22 11:38:37 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-7448d982-d05a-4b80-b295-aa7cdc3cd8d5 req-12493634-8060-4927-a516-e8ca63bf6246 tempest-TestShelveInstance-1099580978 None] Deleting attachment f4533e21-61a5-4863-9c31-371802cabffb. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:38:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-a1f49cbd-42c2-48b8-a6b0-c0c5f2556fd6 req-5d3e65a3-90a5-4eb9-afdf-6b73892d0c94 tempest-TestShelveInstance-1099580978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:38:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-a1f49cbd-42c2-48b8-a6b0-c0c5f2556fd6 req-5d3e65a3-90a5-4eb9-afdf-6b73892d0c94 tempest-TestShelveInstance-1099580978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:38:43 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e3dffb-faf7-4f35-86f9-9e2d953c8a02]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:38:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-a1f49cbd-42c2-48b8-a6b0-c0c5f2556fd6 req-5d3e65a3-90a5-4eb9-afdf-6b73892d0c94 tempest-TestShelveInstance-1099580978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:38:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-a1f49cbd-42c2-48b8-a6b0-c0c5f2556fd6 req-5d3e65a3-90a5-4eb9-afdf-6b73892d0c94 tempest-TestShelveInstance-1099580978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9" returned: 0 in 0.367s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:38:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-a1f49cbd-42c2-48b8-a6b0-c0c5f2556fd6 req-5d3e65a3-90a5-4eb9-afdf-6b73892d0c94 tempest-TestShelveInstance-1099580978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:38:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-a1f49cbd-42c2-48b8-a6b0-c0c5f2556fd6 req-5d3e65a3-90a5-4eb9-afdf-6b73892d0c94 tempest-TestShelveInstance-1099580978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9" returned: 1 in 0.385s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:38:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-a1f49cbd-42c2-48b8-a6b0-c0c5f2556fd6 req-5d3e65a3-90a5-4eb9-afdf-6b73892d0c94 tempest-TestShelveInstance-1099580978 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:38:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-a1f49cbd-42c2-48b8-a6b0-c0c5f2556fd6 req-5d3e65a3-90a5-4eb9-afdf-6b73892d0c94 tempest-TestShelveInstance-1099580978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.932s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:38:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-a1f49cbd-42c2-48b8-a6b0-c0c5f2556fd6 req-5d3e65a3-90a5-4eb9-afdf-6b73892d0c94 tempest-TestShelveInstance-1099580978 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c', 'name': 'volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df50fff2-6f0c-466d-960b-af6d3718e8a6', 'enforce_multipath': True} {{(pid=83310) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 22 11:38:44 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-a1f49cbd-42c2-48b8-a6b0-c0c5f2556fd6 req-5d3e65a3-90a5-4eb9-afdf-6b73892d0c94 tempest-TestShelveInstance-1099580978 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:38:44 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-a1f49cbd-42c2-48b8-a6b0-c0c5f2556fd6 req-5d3e65a3-90a5-4eb9-afdf-6b73892d0c94 tempest-TestShelveInstance-1099580978 None] attachment_update completed successfully. Sep 22 11:38:54 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=6 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:38:54 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:39:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:39:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:39:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:39:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:39:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:39:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:39:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:39:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.126s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:39:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:40:08 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:40:08 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:40:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:40:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:40:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:40:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.103s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:40:19 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-fd2a4ba2-7b13-4ae7-95e0-fffe6d801285 tempest-TestShelveInstance-1099580978 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:40:19 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-fd2a4ba2-7b13-4ae7-95e0-fffe6d801285 tempest-TestShelveInstance-1099580978 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:40:19 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-fd2a4ba2-7b13-4ae7-95e0-fffe6d801285 tempest-TestShelveInstance-1099580978 None] Terminate volume connection completed successfully. Sep 22 11:40:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-fd2a4ba2-7b13-4ae7-95e0-fffe6d801285 tempest-TestShelveInstance-1099580978 None] Deleting attachment df50fff2-6f0c-466d-960b-af6d3718e8a6. {{(pid=83310) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 22 11:40:20 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] Acquiring lock "cinder-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:40:20 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] Lock "cinder-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:40:20 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:40:20 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] Acquiring lock "cinder-quobyte-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:40:20 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] Lock "cinder-quobyte-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9" acquired by "delete_volume" :: waited 0.013s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:40:20 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d7c7e5-e187-40d1-ae87-09868ca9366f]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:40:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:20 devstack quobyte-client[83313]: System call of process 99863 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:40:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9" returned: 0 in 0.425s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9" returned: 1 in 0.377s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:40:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9" returned: 0 in 0.125s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:21 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] Lock "cinder-quobyte-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9" released by "delete_volume" :: held 1.218s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:40:21 devstack cinder-volume[83310]: DEBUG cinder.quota [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] Created reservations ['ec1cc53c-793b-4cc3-a1be-1896c9f17942', 'e77395ff-8e77-41d1-8591-c87ae5ce8a18', 'e19e3342-cc79-4089-9b21-631d0e69af5b', '820b61bb-e18c-4e1c-a269-6567fdefe4b5'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:40:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:40:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:40:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.091s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:22 devstack cinder-volume[83310]: DEBUG cinder.manager [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:40:22 devstack cinder-volume[83310]: INFO cinder.volume.manager [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] Deleted volume successfully. Sep 22 11:40:22 devstack cinder-volume[83310]: DEBUG cinder.coordination [req-47080d21-85b9-4c93-aa9c-80872ae280fc req-ef8bef64-22c8-44bd-adb0-5c633c45a0e2 tempest-TestShelveInstance-1099580978 None] Lock "cinder-f5c2df72-4f84-41ee-b5f9-36e2f6dc9fa9-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:40:31 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=3 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:40:32 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=6,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:40:36 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Flow 'volume_create_manager' (c1eba5f4-eefb-4c88-9b50-54cff6918166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce46aca8-7833-4e09-bf68-789c4e9b8a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce46aca8-7833-4e09-bf68-789c4e9b8a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564607131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a1d330-9739-4e45-85a2-9b9d03c8014b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbeb895238349ad840c74ed94d7960b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:40:36Z,use_quota=True,user_id='80e4778c2f224e66804000185ba29a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8c23e8-c498-4a49-89a8-a2b5fdf4d86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8c23e8-c498-4a49-89a8-a2b5fdf4d86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff40c75e-5f3a-4078-ad6f-5623e7201088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff40c75e-5f3a-4078-ad6f-5623e7201088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5a1d330-9739-4e45-85a2-9b9d03c8014b', 'volume_name': 'volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37c9363-57cc-49d4-b4ae-55a972b7ac3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37c9363-57cc-49d4-b4ae-55a972b7ac3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bc9323-8831-46dc-b211-6bf42d756b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:36 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume a5a1d330-9739-4e45-85a2-9b9d03c8014b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b', 'volume_size': 1} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564607131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a1d330-9739-4e45-85a2-9b9d03c8014b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbeb895238349ad840c74ed94d7960b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:40:36Z,use_quota=True,user_id='80e4778c2f224e66804000185ba29a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Creating volume a5a1d330-9739-4e45-85a2-9b9d03c8014b {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:40:36 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:36 devstack quobyte-client[83313]: System call of process 99878 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:40:36 devstack quobyte-client[83313]: System call of process 99878 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:40:36 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=134, name=volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b 1073741824" returned: 0 in 0.367s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b" returned: 0 in 0.095s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] <== create_volume: return (556ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:40:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.569s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:37 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99bc9323-8831-46dc-b211-6bf42d756b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:37 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb969a7-914a-4ef0-a32e-d84a6cfc527b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:37 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b (a5a1d330-9739-4e45-85a2-9b9d03c8014b): created successfully Sep 22 11:40:37 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb969a7-914a-4ef0-a32e-d84a6cfc527b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:37 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Flow 'volume_create_manager' (c1eba5f4-eefb-4c88-9b50-54cff6918166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:40:37 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-bc2fea1b-95bc-4a50-b9f5-667855ee1838 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Created volume successfully. Sep 22 11:40:38 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:40:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:38 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] Creating offline snapshot 0582661f-43b6-4821-8411-a07f10bf667b of volume a5a1d330-9739-4e45-85a2-9b9d03c8014b {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:40:38 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17fb645-990e-43f1-90b6-d4d298bed94c]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:40:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b" returned: 0 in 0.387s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.0582661f-43b6-4821-8411-a07f10bf667b 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:39 devstack quobyte-client[83313]: System call of process 99885 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:40:39 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=135, name=volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.0582661f-43b6-4821-8411-a07f10bf667b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:40:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.0582661f-43b6-4821-8411-a07f10bf667b 1G" returned: 0 in 0.257s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.0582661f-43b6-4821-8411-a07f10bf667b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:39 devstack quobyte-client[83313]: System call of process 99888 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:40:39 devstack quobyte-client[83313]: System call of process 99888 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:40:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "qemu-img rebase -u -b volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.0582661f-43b6-4821-8411-a07f10bf667b" returned: 0 in 0.140s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.0582661f-43b6-4821-8411-a07f10bf667b is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:40:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.0582661f-43b6-4821-8411-a07f10bf667b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.0582661f-43b6-4821-8411-a07f10bf667b" returned: 0 in 0.086s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:40:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.0582661f-43b6-4821-8411-a07f10bf667b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.0582661f-43b6-4821-8411-a07f10bf667b" returned: 0 in 0.102s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.info" returned: 0 in 0.093s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:40:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.info" returned: 0 in 0.086s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.478s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:40 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-0620b932-8060-49f2-a96a-029050d2576a tempest-CreateVolumesFromSnapshotTest-1869499595 None] Create snapshot completed successfully Sep 22 11:40:41 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Flow 'volume_create_manager' (933eb548-20f8-47fe-8d55-1a948da18d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e654116-ed81-458c-8bc4-477fe4486bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e654116-ed81-458c-8bc4-477fe4486bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1595306665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d619aa9f-a38c-4cb6-812c-50513ef30ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbeb895238349ad840c74ed94d7960b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:40:41Z,use_quota=True,user_id='80e4778c2f224e66804000185ba29a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ef0627-1fe1-44ef-a0a6-fe65d1d3716c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ef0627-1fe1-44ef-a0a6-fe65d1d3716c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc52816-9012-47b2-b22f-786d91ca79d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc52816-9012-47b2-b22f-786d91ca79d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd619aa9f-a38c-4cb6-812c-50513ef30ec7', 'volume_name': 'volume-d619aa9f-a38c-4cb6-812c-50513ef30ec7', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac9b88e-fd04-4bc8-bb56-58a9298cff22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac9b88e-fd04-4bc8-bb56-58a9298cff22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2777e4d4-a0f7-4e06-95f3-3e87c528db44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:41 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume d619aa9f-a38c-4cb6-812c-50513ef30ec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d619aa9f-a38c-4cb6-812c-50513ef30ec7', 'volume_size': 1} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1595306665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d619aa9f-a38c-4cb6-812c-50513ef30ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbeb895238349ad840c74ed94d7960b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:40:41Z,use_quota=True,user_id='80e4778c2f224e66804000185ba29a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Creating volume d619aa9f-a38c-4cb6-812c-50513ef30ec7 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:40:41 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d619aa9f-a38c-4cb6-812c-50513ef30ec7 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:41 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=137, name=volume-d619aa9f-a38c-4cb6-812c-50513ef30ec7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:40:41 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:40:41 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Flow 'volume_create_manager' (da6225f0-a78d-48ec-a353-d7fd2167dce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3102034-aa7f-410a-a9ae-0c648766963e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d619aa9f-a38c-4cb6-812c-50513ef30ec7 1073741824" returned: 0 in 0.742s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d619aa9f-a38c-4cb6-812c-50513ef30ec7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3102034-aa7f-410a-a9ae-0c648766963e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1062917447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e026ce4b-4ff6-457e-bd1d-6d0bed66f22b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbeb895238349ad840c74ed94d7960b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:40:42Z,use_quota=True,user_id='80e4778c2f224e66804000185ba29a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631d2b76-4a03-42af-ad3d-c32a9cf0ae97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631d2b76-4a03-42af-ad3d-c32a9cf0ae97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53680ab5-25bf-4cb0-aa8e-b1d1530af1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53680ab5-25bf-4cb0-aa8e-b1d1530af1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e026ce4b-4ff6-457e-bd1d-6d0bed66f22b', 'volume_name': 'volume-e026ce4b-4ff6-457e-bd1d-6d0bed66f22b', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6e8103-c23e-4c6a-9eb4-604d6afde75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6e8103-c23e-4c6a-9eb4-604d6afde75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0931c5f4-964a-46c7-991c-e11724819cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:42 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume e026ce4b-4ff6-457e-bd1d-6d0bed66f22b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e026ce4b-4ff6-457e-bd1d-6d0bed66f22b', 'volume_size': 1} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d619aa9f-a38c-4cb6-812c-50513ef30ec7" returned: 0 in 0.475s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] <== create_volume: return (1241ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.119s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1062917447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e026ce4b-4ff6-457e-bd1d-6d0bed66f22b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbeb895238349ad840c74ed94d7960b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:40:42Z,use_quota=True,user_id='80e4778c2f224e66804000185ba29a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Creating volume e026ce4b-4ff6-457e-bd1d-6d0bed66f22b {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:40:42 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:40:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e026ce4b-4ff6-457e-bd1d-6d0bed66f22b 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:42 devstack quobyte-client[83313]: System call of process 99899 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:40:42 devstack quobyte-client[83313]: System call of process 99899 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:40:42 devstack quobyte-client[83313]: System call of process 99899 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:40:42 devstack quobyte-client[83313]: System call of process 99899 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:40:42 devstack quobyte-client[83313]: System call of process 99899 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:40:42 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=138, name=volume-e026ce4b-4ff6-457e-bd1d-6d0bed66f22b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:40:43 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Flow 'volume_create_manager' (b6e202e6-2706-4db3-be2c-125c578621a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a10196-5484-4a8d-aae0-6dfcea501ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a10196-5484-4a8d-aae0-6dfcea501ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-885681832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728005ef-4f22-40b2-a7f1-89cff7131fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbeb895238349ad840c74ed94d7960b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:40:42Z,use_quota=True,user_id='80e4778c2f224e66804000185ba29a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6202a292-7604-474e-b4ef-e14de3cad149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6202a292-7604-474e-b4ef-e14de3cad149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8614cd6f-581c-4988-ac3f-72ee5801e86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8614cd6f-581c-4988-ac3f-72ee5801e86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '728005ef-4f22-40b2-a7f1-89cff7131fbc', 'volume_name': 'volume-728005ef-4f22-40b2-a7f1-89cff7131fbc', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86e39a7-bd2b-4b1e-b78d-cd6dc3569b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86e39a7-bd2b-4b1e-b78d-cd6dc3569b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8d7232-d375-49a8-a4f7-4b8a9fc2d83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:43 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume 728005ef-4f22-40b2-a7f1-89cff7131fbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-728005ef-4f22-40b2-a7f1-89cff7131fbc', 'volume_size': 1} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2777e4d4-a0f7-4e06-95f3-3e87c528db44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d619aa9f-a38c-4cb6-812c-50513ef30ec7', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b139b524-f42a-4110-8735-77d64cd807fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e026ce4b-4ff6-457e-bd1d-6d0bed66f22b 1073741824" returned: 0 in 0.773s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e026ce4b-4ff6-457e-bd1d-6d0bed66f22b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:43 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume volume-d619aa9f-a38c-4cb6-812c-50513ef30ec7 (d619aa9f-a38c-4cb6-812c-50513ef30ec7): created successfully Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b139b524-f42a-4110-8735-77d64cd807fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Flow 'volume_create_manager' (933eb548-20f8-47fe-8d55-1a948da18d53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:40:43 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Flow 'volume_create_manager' (99aef217-0ca7-4817-be05-6f34d7c3b0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebb27f5-aeaf-4981-a8e3-62267f265df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:43 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Flow 'volume_create_manager' (9f558a28-56ea-4d5d-8528-e083a5d1b1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13ef28d-dd30-4bac-a539-7599d352eeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e026ce4b-4ff6-457e-bd1d-6d0bed66f22b" returned: 0 in 0.528s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13ef28d-dd30-4bac-a539-7599d352eeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-47057004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5cd9e5a-5607-4520-b56c-3a241a56f795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbeb895238349ad840c74ed94d7960b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:40:43Z,use_quota=True,user_id='80e4778c2f224e66804000185ba29a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6423b403-d48e-446c-b462-ec7b1078448d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6423b403-d48e-446c-b462-ec7b1078448d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e299e27-e921-424f-b982-0c123edb0385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e299e27-e921-424f-b982-0c123edb0385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5cd9e5a-5607-4520-b56c-3a241a56f795', 'volume_name': 'volume-e5cd9e5a-5607-4520-b56c-3a241a56f795', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206d73f2-99c9-416d-9438-1c3ad3aabd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206d73f2-99c9-416d-9438-1c3ad3aabd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339bb84b-fc4e-4109-9353-38684dc60d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:43 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume e5cd9e5a-5607-4520-b56c-3a241a56f795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5cd9e5a-5607-4520-b56c-3a241a56f795', 'volume_size': 1} Sep 22 11:40:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] <== create_volume: return (1371ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.648s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-885681832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728005ef-4f22-40b2-a7f1-89cff7131fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbeb895238349ad840c74ed94d7960b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:40:42Z,use_quota=True,user_id='80e4778c2f224e66804000185ba29a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Creating volume 728005ef-4f22-40b2-a7f1-89cff7131fbc {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:40:44 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-728005ef-4f22-40b2-a7f1-89cff7131fbc 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:44 devstack quobyte-client[83313]: System call of process 99903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:40:44 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-a7bed6dc-0074-4483-8b3f-fdef74fd7e5e tempest-CreateVolumesFromSnapshotTest-1869499595 None] Created volume successfully. Sep 22 11:40:44 devstack quobyte-client[83313]: System call of process 99903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:40:44 devstack quobyte-client[83313]: System call of process 99903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:40:44 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=139, name=volume-728005ef-4f22-40b2-a7f1-89cff7131fbc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebb27f5-aeaf-4981-a8e3-62267f265df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2009744324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39918770-43ac-42e2-9eff-ecde04a189e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbeb895238349ad840c74ed94d7960b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:40:43Z,use_quota=True,user_id='80e4778c2f224e66804000185ba29a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ee19c7-d1d2-4820-8fd9-58b13823af4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ee19c7-d1d2-4820-8fd9-58b13823af4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceee7d88-3828-4ce2-a433-c0f64ceede05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceee7d88-3828-4ce2-a433-c0f64ceede05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39918770-43ac-42e2-9eff-ecde04a189e4', 'volume_name': 'volume-39918770-43ac-42e2-9eff-ecde04a189e4', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac353a7d-8cf0-486f-9f94-9d7b251caad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac353a7d-8cf0-486f-9f94-9d7b251caad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d7f5c0-3f96-4f9e-994f-47c10a81a04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:44 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume 39918770-43ac-42e2-9eff-ecde04a189e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39918770-43ac-42e2-9eff-ecde04a189e4', 'volume_size': 1} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0931c5f4-964a-46c7-991c-e11724819cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e026ce4b-4ff6-457e-bd1d-6d0bed66f22b', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c457dd-b2a2-4ac4-9746-08dc8048f2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-728005ef-4f22-40b2-a7f1-89cff7131fbc 1073741824" returned: 0 in 0.608s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-728005ef-4f22-40b2-a7f1-89cff7131fbc {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-728005ef-4f22-40b2-a7f1-89cff7131fbc" returned: 0 in 0.139s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] <== create_volume: return (792ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.905s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-47057004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5cd9e5a-5607-4520-b56c-3a241a56f795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbeb895238349ad840c74ed94d7960b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:40:43Z,use_quota=True,user_id='80e4778c2f224e66804000185ba29a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Creating volume e5cd9e5a-5607-4520-b56c-3a241a56f795 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:40:44 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:40:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e5cd9e5a-5607-4520-b56c-3a241a56f795 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:45 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=140, name=volume-e5cd9e5a-5607-4520-b56c-3a241a56f795, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:40:45 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume volume-e026ce4b-4ff6-457e-bd1d-6d0bed66f22b (e026ce4b-4ff6-457e-bd1d-6d0bed66f22b): created successfully Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7c457dd-b2a2-4ac4-9746-08dc8048f2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Flow 'volume_create_manager' (da6225f0-a78d-48ec-a353-d7fd2167dce4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8d7232-d375-49a8-a4f7-4b8a9fc2d83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-728005ef-4f22-40b2-a7f1-89cff7131fbc', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ce985d-0b82-4250-90da-e585eee4097e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e5cd9e5a-5607-4520-b56c-3a241a56f795 1073741824" returned: 0 in 0.462s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e5cd9e5a-5607-4520-b56c-3a241a56f795 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:45 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-6ee44487-1f7b-47cb-ad3c-fcfbe4800a89 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Created volume successfully. Sep 22 11:40:45 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume volume-728005ef-4f22-40b2-a7f1-89cff7131fbc (728005ef-4f22-40b2-a7f1-89cff7131fbc): created successfully Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ce985d-0b82-4250-90da-e585eee4097e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Flow 'volume_create_manager' (b6e202e6-2706-4db3-be2c-125c578621a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e5cd9e5a-5607-4520-b56c-3a241a56f795" returned: 0 in 0.443s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] <== create_volume: return (936ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.318s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2009744324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39918770-43ac-42e2-9eff-ecde04a189e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dbeb895238349ad840c74ed94d7960b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:40:43Z,use_quota=True,user_id='80e4778c2f224e66804000185ba29a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Creating volume 39918770-43ac-42e2-9eff-ecde04a189e4 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:40:45 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:40:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-39918770-43ac-42e2-9eff-ecde04a189e4 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:46 devstack quobyte-client[83313]: System call of process 99912 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:40:46 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=141, name=volume-39918770-43ac-42e2-9eff-ecde04a189e4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:40:46 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-e3619cde-7359-49a5-a4aa-1350cb96f132 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Created volume successfully. Sep 22 11:40:46 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339bb84b-fc4e-4109-9353-38684dc60d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5cd9e5a-5607-4520-b56c-3a241a56f795', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:46 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c517a5-99b6-48b4-a89a-65b45867ca15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:46 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume volume-e5cd9e5a-5607-4520-b56c-3a241a56f795 (e5cd9e5a-5607-4520-b56c-3a241a56f795): created successfully Sep 22 11:40:46 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c517a5-99b6-48b4-a89a-65b45867ca15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:46 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Flow 'volume_create_manager' (9f558a28-56ea-4d5d-8528-e083a5d1b1ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:40:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-39918770-43ac-42e2-9eff-ecde04a189e4 1073741824" returned: 0 in 0.467s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-39918770-43ac-42e2-9eff-ecde04a189e4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-39918770-43ac-42e2-9eff-ecde04a189e4" returned: 0 in 0.153s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:46 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] <== create_volume: return (664ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:40:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:46 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-cbcdc3de-4908-4823-8a5f-064636eb6da7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Created volume successfully. Sep 22 11:40:46 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d7f5c0-3f96-4f9e-994f-47c10a81a04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39918770-43ac-42e2-9eff-ecde04a189e4', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:46 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a861664-2855-40da-8444-edb5dfe3b8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:40:46 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume volume-39918770-43ac-42e2-9eff-ecde04a189e4 (39918770-43ac-42e2-9eff-ecde04a189e4): created successfully Sep 22 11:40:46 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a861664-2855-40da-8444-edb5dfe3b8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:40:46 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Flow 'volume_create_manager' (99aef217-0ca7-4817-be05-6f34d7c3b0e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:40:46 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-689eaebd-4343-4676-8671-7245eddac475 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Created volume successfully. Sep 22 11:40:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "cinder-e5cd9e5a-5607-4520-b56c-3a241a56f795-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:40:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-e5cd9e5a-5607-4520-b56c-3a241a56f795-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:40:48 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:40:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "cinder-quobyte-e5cd9e5a-5607-4520-b56c-3a241a56f795" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:40:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-quobyte-e5cd9e5a-5607-4520-b56c-3a241a56f795" acquired by "delete_volume" :: waited 0.022s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:40:48 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9cb391-cefa-4cbf-82e5-f9d3e0d5438b]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:40:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e5cd9e5a-5607-4520-b56c-3a241a56f795 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e5cd9e5a-5607-4520-b56c-3a241a56f795" returned: 0 in 0.431s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e5cd9e5a-5607-4520-b56c-3a241a56f795 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e5cd9e5a-5607-4520-b56c-3a241a56f795" returned: 0 in 0.098s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:49 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-quobyte-e5cd9e5a-5607-4520-b56c-3a241a56f795" released by "delete_volume" :: held 0.710s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:40:49 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Created reservations ['0ea42220-cf9d-4f27-9353-7a692ad813d0', 'eb71755b-7bc5-4201-83bd-7a897a1d3081', 'a70f2650-a793-4660-9cc9-ad0d6ee1ec6d', 'c6914d38-6e36-4b6c-8064-195bdab732b7'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:40:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:40:49 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:40:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.100s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:49 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:40:49 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Deleted volume successfully. Sep 22 11:40:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-76c16d60-a43a-4583-ab18-3e004bbf8ee8 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-e5cd9e5a-5607-4520-b56c-3a241a56f795-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:40:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "cinder-39918770-43ac-42e2-9eff-ecde04a189e4-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:40:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-39918770-43ac-42e2-9eff-ecde04a189e4-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:40:50 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:40:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "cinder-quobyte-39918770-43ac-42e2-9eff-ecde04a189e4" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:40:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-quobyte-39918770-43ac-42e2-9eff-ecde04a189e4" acquired by "delete_volume" :: waited 0.032s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:40:50 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26ec506-8f07-4752-923c-21ab460af0d5]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:40:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-39918770-43ac-42e2-9eff-ecde04a189e4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:51 devstack quobyte-client[83313]: System call of process 99923 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:40:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-39918770-43ac-42e2-9eff-ecde04a189e4" returned: 0 in 0.435s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-39918770-43ac-42e2-9eff-ecde04a189e4 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-39918770-43ac-42e2-9eff-ecde04a189e4" returned: 0 in 0.094s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:51 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-quobyte-39918770-43ac-42e2-9eff-ecde04a189e4" released by "delete_volume" :: held 0.699s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:40:51 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Created reservations ['6bf09e23-2ae5-4631-bb16-011f9ac776e3', 'ebc7033a-c0b9-4082-914f-89d50d498586', 'ce85a13e-490c-4651-b8b5-8e4c811ecd4f', '37791d76-e1b9-49f2-a28f-398dc3de593c'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:40:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:40:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:40:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.132s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:52 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:40:52 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Deleted volume successfully. Sep 22 11:40:52 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-fe603881-b4f3-4914-9bb4-ebba248eb6f4 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-39918770-43ac-42e2-9eff-ecde04a189e4-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:40:52 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "cinder-728005ef-4f22-40b2-a7f1-89cff7131fbc-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:40:52 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-728005ef-4f22-40b2-a7f1-89cff7131fbc-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:40:52 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:40:53 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "cinder-quobyte-728005ef-4f22-40b2-a7f1-89cff7131fbc" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:40:53 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-quobyte-728005ef-4f22-40b2-a7f1-89cff7131fbc" acquired by "delete_volume" :: waited 0.013s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:40:53 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ed7d6e-dacb-4072-990c-e5c95997b366]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:40:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-728005ef-4f22-40b2-a7f1-89cff7131fbc {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:53 devstack quobyte-client[83313]: System call of process 99928 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:40:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-728005ef-4f22-40b2-a7f1-89cff7131fbc" returned: 0 in 0.412s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-728005ef-4f22-40b2-a7f1-89cff7131fbc {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-728005ef-4f22-40b2-a7f1-89cff7131fbc" returned: 0 in 0.096s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:53 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-quobyte-728005ef-4f22-40b2-a7f1-89cff7131fbc" released by "delete_volume" :: held 0.685s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:40:53 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Created reservations ['5844cd4e-a782-48f7-93b4-c412f82502ed', '447a0a06-c53f-4a87-90b0-f928cba87a70', 'c5c635e8-41f4-4155-bdb5-14aa5b2afb39', '3e4e6698-bd37-474c-b16b-c53d93fa46e4'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:40:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:40:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:40:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.090s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:54 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:40:54 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Deleted volume successfully. Sep 22 11:40:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6bdc71e2-8b5d-411f-a108-0964fb3ab7c7 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-728005ef-4f22-40b2-a7f1-89cff7131fbc-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:40:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "cinder-e026ce4b-4ff6-457e-bd1d-6d0bed66f22b-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:40:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-e026ce4b-4ff6-457e-bd1d-6d0bed66f22b-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:40:55 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:40:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "cinder-quobyte-e026ce4b-4ff6-457e-bd1d-6d0bed66f22b" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:40:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-quobyte-e026ce4b-4ff6-457e-bd1d-6d0bed66f22b" acquired by "delete_volume" :: waited 0.023s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:40:55 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5139aa4-9179-4146-bcfe-73e4b65283df]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:40:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e026ce4b-4ff6-457e-bd1d-6d0bed66f22b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e026ce4b-4ff6-457e-bd1d-6d0bed66f22b" returned: 0 in 0.407s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e026ce4b-4ff6-457e-bd1d-6d0bed66f22b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e026ce4b-4ff6-457e-bd1d-6d0bed66f22b" returned: 0 in 0.096s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-quobyte-e026ce4b-4ff6-457e-bd1d-6d0bed66f22b" released by "delete_volume" :: held 0.676s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:40:56 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Created reservations ['cd0ebcf8-0520-4295-8dc4-6e869934f450', '14219208-6568-4285-a673-6bb3fab60a51', '1320c0ff-bd88-46ce-a0e0-dbb26d0ff64d', '5f5092c5-f810-47f1-82a5-01ef8fd3be5e'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:40:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:40:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:40:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.172s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:57 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:40:57 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Deleted volume successfully. Sep 22 11:40:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9f53b7af-fa17-4179-bfbf-5f12ba117118 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-e026ce4b-4ff6-457e-bd1d-6d0bed66f22b-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:40:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "cinder-d619aa9f-a38c-4cb6-812c-50513ef30ec7-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:40:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-d619aa9f-a38c-4cb6-812c-50513ef30ec7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:40:57 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:40:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "cinder-quobyte-d619aa9f-a38c-4cb6-812c-50513ef30ec7" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:40:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-quobyte-d619aa9f-a38c-4cb6-812c-50513ef30ec7" acquired by "delete_volume" :: waited 0.013s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:40:57 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[609711fc-5861-4b14-8426-de3355ab123f]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:40:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d619aa9f-a38c-4cb6-812c-50513ef30ec7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d619aa9f-a38c-4cb6-812c-50513ef30ec7" returned: 0 in 0.408s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d619aa9f-a38c-4cb6-812c-50513ef30ec7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-d619aa9f-a38c-4cb6-812c-50513ef30ec7" returned: 0 in 0.112s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-quobyte-d619aa9f-a38c-4cb6-812c-50513ef30ec7" released by "delete_volume" :: held 0.684s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:40:58 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] Created reservations ['f5d7a826-1542-4b71-b8c1-f2cdeba23978', 'fe1a779c-da53-448f-a7e0-374ea467f2ce', '7fd734d6-8d25-42cc-9785-0d937034763b', 'd4e9f260-f81b-437e-87e1-f73b4c66909d'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:40:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:40:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:40:58 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:40:58 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:40:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:40:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:40:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.106s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:40:58 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:40:59 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] Deleted volume successfully. Sep 22 11:40:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a7f79a05-1eb1-44cf-b80a-92da0d336bcc tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-d619aa9f-a38c-4cb6-812c-50513ef30ec7-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:40:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "cinder-0582661f-43b6-4821-8411-a07f10bf667b-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:40:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-0582661f-43b6-4821-8411-a07f10bf667b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:40:59 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:40:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "cinder-quobyte-a5a1d330-9739-4e45-85a2-9b9d03c8014b" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:40:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-quobyte-a5a1d330-9739-4e45-85a2-9b9d03c8014b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:40:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "cinder-quobyte-0582661f-43b6-4821-8411-a07f10bf667b" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:40:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-quobyte-0582661f-43b6-4821-8411-a07f10bf667b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:40:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Deleting offline snapshot 0582661f-43b6-4821-8411-a07f10bf667b of volume a5a1d330-9739-4e45-85a2-9b9d03c8014b {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:40:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] snapshot_file for this snap is: volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.0582661f-43b6-4821-8411-a07f10bf667b {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:40:59 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c153464f-765c-45af-bfde-f6d5b73b17ae]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:40:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.0582661f-43b6-4821-8411-a07f10bf667b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.0582661f-43b6-4821-8411-a07f10bf667b" returned: 0 in 0.393s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:00 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:41:00 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec77641-3aeb-464c-817e-3032da7ed550]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:41:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b" returned: 0 in 0.414s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.0582661f-43b6-4821-8411-a07f10bf667b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:00 devstack quobyte-client[83313]: System call of process 99988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:41:00 devstack quobyte-client[83313]: System call of process 99988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:41:00 devstack quobyte-client[83313]: System call of process 99988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:41:00 devstack quobyte-client[83313]: System call of process 99988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:41:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.0582661f-43b6-4821-8411-a07f10bf667b" returned: 0 in 0.238s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.0582661f-43b6-4821-8411-a07f10bf667b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b.0582661f-43b6-4821-8411-a07f10bf667b" returned: 0 in 0.091s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:01 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-quobyte-0582661f-43b6-4821-8411-a07f10bf667b" released by "_delete_snapshot" :: held 1.448s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:41:01 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-quobyte-a5a1d330-9739-4e45-85a2-9b9d03c8014b" released by "delete_snapshot" :: held 1.481s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:41:01 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Created reservations ['4b308ee5-38b6-446f-afc0-3dd73a31ba18', '2302e5b5-d0e3-456d-8f7e-833e8a22f4f5', 'c6889aa5-d757-47d2-8545-3dd912e96311', 'aedf6371-4867-4713-a104-bfb0f683c8aa'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:41:01 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Delete snapshot completed successfully. Sep 22 11:41:01 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9259a63f-9f0e-461e-b9b0-deefb0f49288 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-0582661f-43b6-4821-8411-a07f10bf667b-delete_snapshot" released by "delete_snapshot" :: held 1.922s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:41:01 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "cinder-a5a1d330-9739-4e45-85a2-9b9d03c8014b-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:41:01 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-a5a1d330-9739-4e45-85a2-9b9d03c8014b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:41:02 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:41:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "cinder-quobyte-a5a1d330-9739-4e45-85a2-9b9d03c8014b" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:41:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-quobyte-a5a1d330-9739-4e45-85a2-9b9d03c8014b" acquired by "delete_volume" :: waited 0.013s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:41:02 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[7280d28f-292c-45eb-ba0b-ebe3a3559a81]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:41:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b" returned: 0 in 0.398s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a5a1d330-9739-4e45-85a2-9b9d03c8014b" returned: 0 in 0.109s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-quobyte-a5a1d330-9739-4e45-85a2-9b9d03c8014b" released by "delete_volume" :: held 0.678s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:41:02 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Created reservations ['935bcf62-4227-4ee1-92fe-35ca659ac7f6', '98e77789-81be-4542-84f3-a78dfec82029', 'a792c8a2-b566-48c0-8bae-75a566629da0', 'c55d3dfa-51e4-4d7b-a095-89f309c829a7'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:41:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:41:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:41:03 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:41:03 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:41:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:41:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.142s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:03 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:41:03 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Deleted volume successfully. Sep 22 11:41:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-18bbaf8b-cb9a-4e5f-8789-bac6792bd9b2 tempest-CreateVolumesFromSnapshotTest-1869499595 None] Lock "cinder-a5a1d330-9739-4e45-85a2-9b9d03c8014b-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:41:13 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=45,cinder:UPDATE=61,cinder:DELETE=5,cinder:INSERT=14 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:41:13 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=72,cinder:DELETE=8,cinder:SELECT=39,cinder:INSERT=14 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:41:17 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:41:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:41:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:41:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:41:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:41:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:41:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.126s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:17 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:41:26 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Flow 'volume_create_manager' (901c7579-d5e7-4775-ae9c-336561f3b5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3726e1-9066-4701-af41-6fa040e2a4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3726e1-9066-4701-af41-6fa040e2a4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-726740442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60152dee-938f-42a1-882e-140468819009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b18c21054a844a7b2f9132249e2b069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:41:26Z,use_quota=True,user_id='cd367da870bb44d9b992c05b67ea9396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e9f949-fa3c-4ce2-9c60-0a87b45240d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e9f949-fa3c-4ce2-9c60-0a87b45240d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6daac54e-c730-41e9-874e-8aeb82f3a19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6daac54e-c730-41e9-874e-8aeb82f3a19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60152dee-938f-42a1-882e-140468819009', 'volume_name': 'volume-60152dee-938f-42a1-882e-140468819009', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d122ac5-d30a-4f3a-9bfa-904b52d8293b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d122ac5-d30a-4f3a-9bfa-904b52d8293b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b2c1d5-bbbc-47ea-844f-c5a5d288e171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:41:26 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Volume 60152dee-938f-42a1-882e-140468819009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60152dee-938f-42a1-882e-140468819009', 'volume_size': 1} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-726740442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60152dee-938f-42a1-882e-140468819009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b18c21054a844a7b2f9132249e2b069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:41:26Z,use_quota=True,user_id='cd367da870bb44d9b992c05b67ea9396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Creating volume 60152dee-938f-42a1-882e-140468819009 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:41:26 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:26 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=142, name=volume-60152dee-938f-42a1-882e-140468819009, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009 1073741824" returned: 0 in 0.364s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009" returned: 0 in 0.087s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] <== create_volume: return (523ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:41:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.536s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:41:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b2c1d5-bbbc-47ea-844f-c5a5d288e171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60152dee-938f-42a1-882e-140468819009', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:41:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e363e21-eae5-4406-8a00-8dbbb871a1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:41:27 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Volume volume-60152dee-938f-42a1-882e-140468819009 (60152dee-938f-42a1-882e-140468819009): created successfully Sep 22 11:41:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e363e21-eae5-4406-8a00-8dbbb871a1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:41:27 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Flow 'volume_create_manager' (901c7579-d5e7-4775-ae9c-336561f3b5d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:41:27 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-bfd4eea8-db95-4d60-ac9a-16e7ada9f1d2 tempest-SnapshotDependencyTests-236166730 None] Created volume successfully. Sep 22 11:41:28 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:41:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:41:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:41:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] Creating offline snapshot 64df172f-ba6b-43a3-af02-440142844ef0 of volume 60152dee-938f-42a1-882e-140468819009 {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:41:28 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dc4709-ffc3-45f1-88d0-6ebc5b126629]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:41:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009" returned: 0 in 0.400s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.64df172f-ba6b-43a3-af02-440142844ef0 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:29 devstack quobyte-client[83313]: System call of process 100012 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:41:29 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=143, name=volume-60152dee-938f-42a1-882e-140468819009.64df172f-ba6b-43a3-af02-440142844ef0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:41:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.64df172f-ba6b-43a3-af02-440142844ef0 1G" returned: 0 in 0.285s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): qemu-img rebase -u -b volume-60152dee-938f-42a1-882e-140468819009 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.64df172f-ba6b-43a3-af02-440142844ef0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] CMD "qemu-img rebase -u -b volume-60152dee-938f-42a1-882e-140468819009 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.64df172f-ba6b-43a3-af02-440142844ef0" returned: 0 in 0.144s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.64df172f-ba6b-43a3-af02-440142844ef0 is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:41:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.64df172f-ba6b-43a3-af02-440142844ef0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.64df172f-ba6b-43a3-af02-440142844ef0" returned: 0 in 0.096s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009 -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:41:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.64df172f-ba6b-43a3-af02-440142844ef0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.64df172f-ba6b-43a3-af02-440142844ef0" returned: 0 in 0.106s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.info" returned: 0 in 0.118s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:41:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.info" returned: 0 in 0.094s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.605s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:41:30 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-970f3f02-ac4c-4c14-b9dc-bdaaed1eb59f tempest-SnapshotDependencyTests-236166730 None] Create snapshot completed successfully Sep 22 11:41:31 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Flow 'volume_create_manager' (2db2cbd4-c6d4-4a4b-bf18-8682252d4c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22cfb62-5c5a-4605-be9e-067bcffb3f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22cfb62-5c5a-4605-be9e-067bcffb3f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151cc036-599e-47f0-925d-50e0e660f641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b18c21054a844a7b2f9132249e2b069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=64df172f-ba6b-43a3-af02-440142844ef0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:41:31Z,use_quota=True,user_id='cd367da870bb44d9b992c05b67ea9396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5a7eb0-6af4-4445-a576-4aaedc07c5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5a7eb0-6af4-4445-a576-4aaedc07c5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437bdfa2-cdc9-4a14-b28e-fd54ac65d22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437bdfa2-cdc9-4a14-b28e-fd54ac65d22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '151cc036-599e-47f0-925d-50e0e660f641', 'volume_name': 'volume-151cc036-599e-47f0-925d-50e0e660f641', 'volume_size': 1, 'snapshot_id': '64df172f-ba6b-43a3-af02-440142844ef0'}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712e7ed7-98a4-4edd-9dc8-b3e36bed449d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712e7ed7-98a4-4edd-9dc8-b3e36bed449d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75099367-f20e-4212-b767-fcf8a61b950e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:41:31 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Volume 151cc036-599e-47f0-925d-50e0e660f641: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-151cc036-599e-47f0-925d-50e0e660f641', 'volume_size': 1, 'snapshot_id': '64df172f-ba6b-43a3-af02-440142844ef0'} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Acquiring lock "cinder-quobyte-64df172f-ba6b-43a3-af02-440142844ef0-151cc036-599e-47f0-925d-50e0e660f641" by "_create_volume_from_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Lock "cinder-quobyte-64df172f-ba6b-43a3-af02-440142844ef0-151cc036-599e-47f0-925d-50e0e660f641" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Creating volume 151cc036-599e-47f0-925d-50e0e660f641 from snapshot 64df172f-ba6b-43a3-af02-440142844ef0 {{(pid=83310) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Acquiring lock "cinder-quobyte-151cc036-599e-47f0-925d-50e0e660f641" by "_copy_volume_from_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Lock "cinder-quobyte-151cc036-599e-47f0-925d-50e0e660f641" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] snapshot: 64df172f-ba6b-43a3-af02-440142844ef0, volume: 151cc036-599e-47f0-925d-50e0e660f641, {{(pid=83310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6bab25-15d5-46dc-b47b-cec61f2aaa54]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.64df172f-ba6b-43a3-af02-440142844ef0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.64df172f-ba6b-43a3-af02-440142844ef0" returned: 0 in 0.371s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60152dee-938f-42a1-882e-140468819009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009 {{(pid=83310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Creating direct copy from snapshot {{(pid=83310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[146e21f4-7e2d-4933-bc7e-aa743026f3da]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:41:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009" returned: 0 in 0.395s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:32 devstack cinder-volume[83310]: DEBUG cinder.utils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-151cc036-599e-47f0-925d-50e0e660f641 not found in is_blk_device check {{(pid=83310) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 22 11:41:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-151cc036-599e-47f0-925d-50e0e660f641 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:32 devstack quobyte-client[83313]: System call of process 100028 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:41:32 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=145, name=volume-151cc036-599e-47f0-925d-50e0e660f641, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:41:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-151cc036-599e-47f0-925d-50e0e660f641" returned: 0 in 5.471s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:37 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[155ddf03-5b06-48d5-90fa-312de027ce72]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:41:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:38 devstack quobyte-client[83313]: System call of process 100039 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:41:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009" returned: 0 in 0.552s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:38 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Image conversion details: src /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-151cc036-599e-47f0-925d-50e0e660f641 {{(pid=83310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 22 11:41:38 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Converted 1024.00 MB image at 186.31 MB/s Sep 22 11:41:38 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-151cc036-599e-47f0-925d-50e0e660f641 is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:41:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-151cc036-599e-47f0-925d-50e0e660f641 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-151cc036-599e-47f0-925d-50e0e660f641" returned: 0 in 0.091s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:38 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Lock "cinder-quobyte-151cc036-599e-47f0-925d-50e0e660f641" released by "_copy_volume_from_snapshot" :: held 7.239s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:41:38 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Lock "cinder-quobyte-64df172f-ba6b-43a3-af02-440142844ef0-151cc036-599e-47f0-925d-50e0e660f641" released by "_create_volume_from_snapshot" :: held 7.277s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:41:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.299s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:41:38 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75099367-f20e-4212-b767-fcf8a61b950e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-151cc036-599e-47f0-925d-50e0e660f641', 'volume_size': 1, 'snapshot_id': '64df172f-ba6b-43a3-af02-440142844ef0'}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:41:38 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887e10e5-0481-48e6-8afc-b6535ef7b1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:41:38 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Volume volume-151cc036-599e-47f0-925d-50e0e660f641 (151cc036-599e-47f0-925d-50e0e660f641): created successfully Sep 22 11:41:38 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887e10e5-0481-48e6-8afc-b6535ef7b1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:41:38 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Flow 'volume_create_manager' (2db2cbd4-c6d4-4a4b-bf18-8682252d4c34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:41:38 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-3bcdd4ff-10dd-4158-a56a-201e12ab5f9c tempest-SnapshotDependencyTests-236166730 None] Created volume successfully. Sep 22 11:41:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] Acquiring lock "cinder-64df172f-ba6b-43a3-af02-440142844ef0-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:41:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] Lock "cinder-64df172f-ba6b-43a3-af02-440142844ef0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:41:39 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:41:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] Acquiring lock "cinder-quobyte-60152dee-938f-42a1-882e-140468819009" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:41:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] Lock "cinder-quobyte-60152dee-938f-42a1-882e-140468819009" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:41:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] Acquiring lock "cinder-quobyte-64df172f-ba6b-43a3-af02-440142844ef0" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:41:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] Lock "cinder-quobyte-64df172f-ba6b-43a3-af02-440142844ef0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:41:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] Deleting offline snapshot 64df172f-ba6b-43a3-af02-440142844ef0 of volume 60152dee-938f-42a1-882e-140468819009 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:41:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] snapshot_file for this snap is: volume-60152dee-938f-42a1-882e-140468819009.64df172f-ba6b-43a3-af02-440142844ef0 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:41:39 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a2b48c-df30-4883-b439-95c1a6f6b6a5]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:41:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.64df172f-ba6b-43a3-af02-440142844ef0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.64df172f-ba6b-43a3-af02-440142844ef0" returned: 0 in 0.388s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60152dee-938f-42a1-882e-140468819009(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:41:39 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4d5ca1-1482-4f70-8589-da755a714748]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:41:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009" returned: 0 in 0.405s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.64df172f-ba6b-43a3-af02-440142844ef0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.64df172f-ba6b-43a3-af02-440142844ef0" returned: 0 in 0.264s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.64df172f-ba6b-43a3-af02-440142844ef0 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009.64df172f-ba6b-43a3-af02-440142844ef0" returned: 0 in 0.153s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:40 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] Lock "cinder-quobyte-64df172f-ba6b-43a3-af02-440142844ef0" released by "_delete_snapshot" :: held 1.448s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:41:40 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] Lock "cinder-quobyte-60152dee-938f-42a1-882e-140468819009" released by "delete_snapshot" :: held 1.471s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:41:41 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] Created reservations ['8095dbdc-83bc-46ee-90f3-89e1c8bbea02', '95042e4e-25b9-4a9a-9dbd-d006606336cb', 'ee755d5b-b2b7-4777-a67d-bc0fba22575f', '1b25c54f-7e65-43ab-b6d3-dd8d17854f75'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:41:41 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] Delete snapshot completed successfully. Sep 22 11:41:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-7161d82d-003a-408d-a829-31b859abc822 tempest-SnapshotDependencyTests-236166730 None] Lock "cinder-64df172f-ba6b-43a3-af02-440142844ef0-delete_snapshot" released by "delete_snapshot" :: held 1.981s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:41:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] Acquiring lock "cinder-60152dee-938f-42a1-882e-140468819009-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:41:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] Lock "cinder-60152dee-938f-42a1-882e-140468819009-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:41:41 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:41:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] Acquiring lock "cinder-quobyte-60152dee-938f-42a1-882e-140468819009" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:41:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] Lock "cinder-quobyte-60152dee-938f-42a1-882e-140468819009" acquired by "delete_volume" :: waited 0.024s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:41:41 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[18205918-2896-4aa5-a401-c8b45debb40c]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:41:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:41 devstack quobyte-client[83313]: System call of process 100053 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:41:41 devstack quobyte-client[83313]: System call of process 100053 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:41:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009" returned: 0 in 0.416s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-60152dee-938f-42a1-882e-140468819009" returned: 0 in 0.113s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:42 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] Lock "cinder-quobyte-60152dee-938f-42a1-882e-140468819009" released by "delete_volume" :: held 0.694s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:41:42 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] Created reservations ['fe0997c1-a8c2-41b2-9282-be9e524435be', '49d1070c-89c7-4744-a0cd-b3dc70e1eb2c', '63282c4c-d260-421f-ba00-a2744e442627', '2e4420e7-9cc7-49d9-823f-80b182a4b02b'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:41:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:41:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:41:42 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:41:42 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:41:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:41:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.114s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:42 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:41:42 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] Deleted volume successfully. Sep 22 11:41:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a526743d-c214-4d2f-9d13-70c0091092f0 tempest-SnapshotDependencyTests-236166730 None] Lock "cinder-60152dee-938f-42a1-882e-140468819009-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:41:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] Acquiring lock "cinder-151cc036-599e-47f0-925d-50e0e660f641-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:41:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] Lock "cinder-151cc036-599e-47f0-925d-50e0e660f641-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:41:43 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:41:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] Acquiring lock "cinder-quobyte-151cc036-599e-47f0-925d-50e0e660f641" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:41:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] Lock "cinder-quobyte-151cc036-599e-47f0-925d-50e0e660f641" acquired by "delete_volume" :: waited 0.011s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:41:43 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a60377-f3bf-49e1-9874-80836a41cab6]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:41:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-151cc036-599e-47f0-925d-50e0e660f641 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-151cc036-599e-47f0-925d-50e0e660f641" returned: 0 in 0.412s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-151cc036-599e-47f0-925d-50e0e660f641 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-151cc036-599e-47f0-925d-50e0e660f641" returned: 0 in 0.105s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] Lock "cinder-quobyte-151cc036-599e-47f0-925d-50e0e660f641" released by "delete_volume" :: held 0.684s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:41:44 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] Created reservations ['faf5af5f-159f-436c-b6b2-2faf54abd1ec', 'e7bfcc71-597a-41bd-b533-0af56a5551c1', '0baf4c63-d541-4f5e-b348-bd8ff3bd72cf', '0b243559-d6b6-4cc6-a572-9100339498d0'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:41:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:41:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:41:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:41:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:41:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:41:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:41:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.092s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:41:45 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:41:45 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] Deleted volume successfully. Sep 22 11:41:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-4576c348-945d-4a9d-86e6-0869f41be8a0 tempest-SnapshotDependencyTests-236166730 None] Lock "cinder-151cc036-599e-47f0-925d-50e0e660f641-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:41:54 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=29,cinder:SELECT=19,cinder:DELETE=2,cinder:INSERT=9 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:41:55 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=20,cinder:UPDATE=24,cinder:DELETE=3,cinder:INSERT=3 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:42:08 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:42:08 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:42:15 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Flow 'volume_create_manager' (fa1a195e-63c3-434a-9f24-e1a887b2b4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca4e32c-51f1-4c3b-890b-b5d466243fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca4e32c-51f1-4c3b-890b-b5d466243fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-376966253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca1bfd7c-26a8-403c-a0aa-7b63b285b126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed8de623bcee486b8c8e1d780c8026d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:15Z,use_quota=True,user_id='a634bf15a9e44bd88b931854c7cd3f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6e50ef-c754-4b6c-aa2d-a2b7b45ba3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6e50ef-c754-4b6c-aa2d-a2b7b45ba3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4dd6a48-85f2-49e9-b636-f6be71808cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4dd6a48-85f2-49e9-b636-f6be71808cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca1bfd7c-26a8-403c-a0aa-7b63b285b126', 'volume_name': 'volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397539e4-c46b-4df9-83b3-56dfb88dc4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397539e4-c46b-4df9-83b3-56dfb88dc4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f3d7d5-c119-4318-839e-be6754120b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:15 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume ca1bfd7c-26a8-403c-a0aa-7b63b285b126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126', 'volume_size': 1} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-376966253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca1bfd7c-26a8-403c-a0aa-7b63b285b126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed8de623bcee486b8c8e1d780c8026d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:15Z,use_quota=True,user_id='a634bf15a9e44bd88b931854c7cd3f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Creating volume ca1bfd7c-26a8-403c-a0aa-7b63b285b126 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:42:15 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:42:15 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:16 devstack quobyte-client[83313]: System call of process 100156 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:16 devstack quobyte-client[83313]: System call of process 100156 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:16 devstack quobyte-client[83313]: System call of process 100156 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:16 devstack quobyte-client[83313]: System call of process 100156 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:16 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=146, name=volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:42:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126 1073741824" returned: 0 in 0.842s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:16 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:16 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Flow 'volume_create_manager' (0ea98102-07f2-4e2e-bdde-2c992fd0be17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c969db11-dc7f-4dfb-9ae7-b9ed6d3e4982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c969db11-dc7f-4dfb-9ae7-b9ed6d3e4982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1732686333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9914b286-11c5-4ffd-8dba-be76aa6dd130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d65ddf7c9194c9683c36f4b51ea8fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:16Z,use_quota=True,user_id='5e3ed5e48e514539b25b3d8efdaa540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1ceaeb-e33c-4089-af6f-f7bca35fa02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1ceaeb-e33c-4089-af6f-f7bca35fa02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b07000b-cbdd-469b-96f0-194ac709967b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b07000b-cbdd-469b-96f0-194ac709967b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9914b286-11c5-4ffd-8dba-be76aa6dd130', 'volume_name': 'volume-9914b286-11c5-4ffd-8dba-be76aa6dd130', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15856f7f-a4c3-4bcc-98e6-e3c008b7e29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15856f7f-a4c3-4bcc-98e6-e3c008b7e29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7752e6-42fb-4bc7-89c8-150fa6763336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:17 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Volume 9914b286-11c5-4ffd-8dba-be76aa6dd130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9914b286-11c5-4ffd-8dba-be76aa6dd130', 'volume_size': 1} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126" returned: 0 in 0.907s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] <== create_volume: return (1814ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1732686333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9914b286-11c5-4ffd-8dba-be76aa6dd130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d65ddf7c9194c9683c36f4b51ea8fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:16Z,use_quota=True,user_id='5e3ed5e48e514539b25b3d8efdaa540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Creating volume 9914b286-11c5-4ffd-8dba-be76aa6dd130 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:42:17 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-9914b286-11c5-4ffd-8dba-be76aa6dd130 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:17 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:17 devstack quobyte-client[83313]: System call of process 100160 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:17 devstack quobyte-client[83313]: System call of process 100160 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:17 devstack quobyte-client[83313]: System call of process 100160 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:17 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:42:17 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=147, name=volume-9914b286-11c5-4ffd-8dba-be76aa6dd130, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Flow 'volume_create_manager' (9a9a5e61-d7aa-4607-94da-920cece873fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070fcdf9-aa57-4e32-8096-b696b55a35ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f3d7d5-c119-4318-839e-be6754120b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d60d796-65a6-40fa-a05c-4dae993f44fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070fcdf9-aa57-4e32-8096-b696b55a35ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2066372359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c17bf28-c726-479a-ad2b-49223b621b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d65ddf7c9194c9683c36f4b51ea8fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:17Z,use_quota=True,user_id='5e3ed5e48e514539b25b3d8efdaa540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a7f02ed-a6a8-4916-a024-50031cd9bcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a7f02ed-a6a8-4916-a024-50031cd9bcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5512c90-fdda-42b7-bbd5-4970fef268b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5512c90-fdda-42b7-bbd5-4970fef268b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c17bf28-c726-479a-ad2b-49223b621b43', 'volume_name': 'volume-9c17bf28-c726-479a-ad2b-49223b621b43', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4405b8e1-f7bb-4816-9f4a-26828dfa3502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4405b8e1-f7bb-4816-9f4a-26828dfa3502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416b5014-097c-4876-a6b6-9d55c63b78cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:18 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Volume 9c17bf28-c726-479a-ad2b-49223b621b43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c17bf28-c726-479a-ad2b-49223b621b43', 'volume_size': 1} Sep 22 11:42:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:18 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Flow 'volume_create_manager' (ffce2e07-24f6-49c5-a59e-60166a4a11b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a848eadb-a5ae-4a07-ba8c-08f5c41abb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:19 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Flow 'volume_create_manager' (66edea1d-5640-4764-a81f-b5a34232ecf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (313064cc-af62-4765-8b09-f66062b8fe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a848eadb-a5ae-4a07-ba8c-08f5c41abb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1040315630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf37432b-f3aa-4d07-9baf-8f1881f6f777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d65ddf7c9194c9683c36f4b51ea8fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:17Z,use_quota=True,user_id='5e3ed5e48e514539b25b3d8efdaa540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aeb7499-521c-4213-b426-21c3c8af15fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aeb7499-521c-4213-b426-21c3c8af15fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3dea57d-28d2-442f-b755-6c63d299651b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3dea57d-28d2-442f-b755-6c63d299651b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf37432b-f3aa-4d07-9baf-8f1881f6f777', 'volume_name': 'volume-cf37432b-f3aa-4d07-9baf-8f1881f6f777', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490a7984-6cad-4fee-977e-fc2952009b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490a7984-6cad-4fee-977e-fc2952009b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549858c0-320a-47e3-ab21-eaea68b4808a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:19 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Volume cf37432b-f3aa-4d07-9baf-8f1881f6f777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf37432b-f3aa-4d07-9baf-8f1881f6f777', 'volume_size': 1} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-9914b286-11c5-4ffd-8dba-be76aa6dd130 1073741824" returned: 0 in 1.550s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.784s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-9914b286-11c5-4ffd-8dba-be76aa6dd130 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (313064cc-af62-4765-8b09-f66062b8fe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1871679359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dde3d1-377e-4926-90d9-47ecbc2b92f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d65ddf7c9194c9683c36f4b51ea8fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:17Z,use_quota=True,user_id='5e3ed5e48e514539b25b3d8efdaa540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2afb2058-52ba-4829-bfd2-4021be963c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2afb2058-52ba-4829-bfd2-4021be963c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c930851b-3944-4551-bd5b-c72c70e47407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c930851b-3944-4551-bd5b-c72c70e47407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95dde3d1-377e-4926-90d9-47ecbc2b92f3', 'volume_name': 'volume-95dde3d1-377e-4926-90d9-47ecbc2b92f3', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7156374-bb3e-4905-ac2a-be8546dae8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7156374-bb3e-4905-ac2a-be8546dae8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4067af-7aff-4417-8980-dcffce1361f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:19 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Volume 95dde3d1-377e-4926-90d9-47ecbc2b92f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95dde3d1-377e-4926-90d9-47ecbc2b92f3', 'volume_size': 1} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:42:19 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126 (ca1bfd7c-26a8-403c-a0aa-7b63b285b126): created successfully Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d60d796-65a6-40fa-a05c-4dae993f44fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Flow 'volume_create_manager' (fa1a195e-63c3-434a-9f24-e1a887b2b4fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-9914b286-11c5-4ffd-8dba-be76aa6dd130" returned: 0 in 0.598s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] <== create_volume: return (2194ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.209s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.845s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2066372359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c17bf28-c726-479a-ad2b-49223b621b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d65ddf7c9194c9683c36f4b51ea8fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:17Z,use_quota=True,user_id='5e3ed5e48e514539b25b3d8efdaa540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Creating volume 9c17bf28-c726-479a-ad2b-49223b621b43 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:42:19 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:42:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-9c17bf28-c726-479a-ad2b-49223b621b43 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:19 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:42:20 devstack quobyte-client[83313]: System call of process 100165 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:20 devstack quobyte-client[83313]: System call of process 100165 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:20 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=148, name=volume-9c17bf28-c726-479a-ad2b-49223b621b43, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Flow 'volume_create_manager' (fcec20c1-307a-4fee-94cd-bca9cd261a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8271661-eb50-438a-9aca-05c45970bf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8271661-eb50-438a-9aca-05c45970bf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2014794973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59dbdd92-b00a-4a1d-b83d-dd538be24278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d65ddf7c9194c9683c36f4b51ea8fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:18Z,use_quota=True,user_id='5e3ed5e48e514539b25b3d8efdaa540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dbfcb58-72d9-45c4-af89-00f4aa66307f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dbfcb58-72d9-45c4-af89-00f4aa66307f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0105bcd-578f-449b-b555-6c49dc329595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0105bcd-578f-449b-b555-6c49dc329595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59dbdd92-b00a-4a1d-b83d-dd538be24278', 'volume_name': 'volume-59dbdd92-b00a-4a1d-b83d-dd538be24278', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d80fa6-607c-4b23-b5a0-120333063dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d80fa6-607c-4b23-b5a0-120333063dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (818913e8-bc43-42a8-9c58-e3ece9eb0f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:20 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Volume 59dbdd92-b00a-4a1d-b83d-dd538be24278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59dbdd92-b00a-4a1d-b83d-dd538be24278', 'volume_size': 1} Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7752e6-42fb-4bc7-89c8-150fa6763336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9914b286-11c5-4ffd-8dba-be76aa6dd130', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e927fda5-a0b2-4fea-9baf-4a9d6dc200bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:20 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-c86e0d2c-e938-48b3-98a9-aea1c867d16e tempest-CreateVolumesFromSnapshotTest-1543696716 None] Created volume successfully. Sep 22 11:42:20 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-9c17bf28-c726-479a-ad2b-49223b621b43 1073741824" returned: 0 in 0.710s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-9c17bf28-c726-479a-ad2b-49223b621b43 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:20 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Flow 'volume_create_manager' (2567e91a-1e34-4bd9-ab29-910f09436646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7fb656-bc36-4abe-b591-e6e5c53e316d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:20 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Volume volume-9914b286-11c5-4ffd-8dba-be76aa6dd130 (9914b286-11c5-4ffd-8dba-be76aa6dd130): created successfully Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e927fda5-a0b2-4fea-9baf-4a9d6dc200bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Flow 'volume_create_manager' (0ea98102-07f2-4e2e-bdde-2c992fd0be17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7fb656-bc36-4abe-b591-e6e5c53e316d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9b69f0-a1ca-4677-87d0-e3c698463871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d39ea121a2e4a1caf9bc751a637d495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:20Z,use_quota=True,user_id='2619d76b5dfe4913b48dec1469cf5b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c138e8a5-c914-4c69-9325-d2fc858384b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c138e8a5-c914-4c69-9325-d2fc858384b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0873edef-1ca3-4cfc-94ba-cd33e6956fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG cinder.image.glance [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Creating Keystone auth plugin from conf {{(pid=83310) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-9c17bf28-c726-479a-ad2b-49223b621b43" returned: 0 in 0.631s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] <== create_volume: return (1366ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.038s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1040315630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf37432b-f3aa-4d07-9baf-8f1881f6f777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d65ddf7c9194c9683c36f4b51ea8fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:17Z,use_quota=True,user_id='5e3ed5e48e514539b25b3d8efdaa540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Creating volume cf37432b-f3aa-4d07-9baf-8f1881f6f777 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:42:21 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-cf37432b-f3aa-4d07-9baf-8f1881f6f777 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:21 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=149, name=volume-cf37432b-f3aa-4d07-9baf-8f1881f6f777, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:42:21 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-291bc4f8-7ce0-4e58-9808-18998945eb68 tempest-CreateVolumesFromImageTest-236762478 None] Created volume successfully. Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416b5014-097c-4876-a6b6-9d55c63b78cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c17bf28-c726-479a-ad2b-49223b621b43', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d28cbd8-9508-435d-ba98-1f813cdc8e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-cf37432b-f3aa-4d07-9baf-8f1881f6f777 1073741824" returned: 0 in 0.579s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-cf37432b-f3aa-4d07-9baf-8f1881f6f777 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:22 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Volume volume-9c17bf28-c726-479a-ad2b-49223b621b43 (9c17bf28-c726-479a-ad2b-49223b621b43): created successfully Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d28cbd8-9508-435d-ba98-1f813cdc8e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Flow 'volume_create_manager' (9a9a5e61-d7aa-4607-94da-920cece873fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:22 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-15e39a8d-2f41-4ad3-a5a1-46fea4be03f5 tempest-CreateVolumesFromImageTest-236762478 None] Created volume successfully. Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-cf37432b-f3aa-4d07-9baf-8f1881f6f777" returned: 0 in 0.486s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] <== create_volume: return (1094ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.892s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1871679359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dde3d1-377e-4926-90d9-47ecbc2b92f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d65ddf7c9194c9683c36f4b51ea8fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:17Z,use_quota=True,user_id='5e3ed5e48e514539b25b3d8efdaa540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Creating volume 95dde3d1-377e-4926-90d9-47ecbc2b92f3 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:42:22 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-95dde3d1-377e-4926-90d9-47ecbc2b92f3 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:22 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=150, name=volume-95dde3d1-377e-4926-90d9-47ecbc2b92f3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549858c0-320a-47e3-ab21-eaea68b4808a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf37432b-f3aa-4d07-9baf-8f1881f6f777', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747a38d2-d274-4de7-9cd2-460d0ab5693b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0873edef-1ca3-4cfc-94ba-cd33e6956fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0d9b69f0-a1ca-4677-87d0-e3c698463871', 'volume_name': 'volume-0d9b69f0-a1ca-4677-87d0-e3c698463871', 'volume_size': 1, 'image_id': '2fc8709f-dffd-4783-b17e-a40e5a8794f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fc8709f-dffd-4783-b17e-a40e5a8794f7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b6e3781a80c9318033d1ffb81a964cb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6d39ea121a2e4a1caf9bc751a637d495', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f37d6aedf45908a8b17622fd3c75db34ce50760d3012c84252fb3aca4a3f8cc671fec6215a1ea03db9b2ee8021359ac638d077d70dc4251dc3117f0839033c53', 'id': '2fc8709f-dffd-4783-b17e-a40e5a8794f7', 'created_at': datetime.datetime(2025, 9, 22, 9, 42, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 9, 42, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fc8709f-dffd-4783-b17e-a40e5a8794f7/file', 'properties': {}}, 'image_service': }' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0718a284-75ea-4a69-824d-acbfdf9acfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0718a284-75ea-4a69-824d-acbfdf9acfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73a0b98-1286-4354-b200-8e489424192b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:22 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Volume 0d9b69f0-a1ca-4677-87d0-e3c698463871: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0d9b69f0-a1ca-4677-87d0-e3c698463871', 'volume_size': 1, 'image_id': '2fc8709f-dffd-4783-b17e-a40e5a8794f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fc8709f-dffd-4783-b17e-a40e5a8794f7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b6e3781a80c9318033d1ffb81a964cb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6d39ea121a2e4a1caf9bc751a637d495', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f37d6aedf45908a8b17622fd3c75db34ce50760d3012c84252fb3aca4a3f8cc671fec6215a1ea03db9b2ee8021359ac638d077d70dc4251dc3117f0839033c53', 'id': '2fc8709f-dffd-4783-b17e-a40e5a8794f7', 'created_at': datetime.datetime(2025, 9, 22, 9, 42, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 9, 42, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fc8709f-dffd-4783-b17e-a40e5a8794f7/file', 'properties': {}}, 'image_service': } Sep 22 11:42:22 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Cloning 0d9b69f0-a1ca-4677-87d0-e3c698463871 from image 2fc8709f-dffd-4783-b17e-a40e5a8794f7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2fc8709f-dffd-4783-b17e-a40e5a8794f7', 'metadata': {}}]). {{(pid=83310) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 22 11:42:23 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Volume volume-cf37432b-f3aa-4d07-9baf-8f1881f6f777 (cf37432b-f3aa-4d07-9baf-8f1881f6f777): created successfully Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747a38d2-d274-4de7-9cd2-460d0ab5693b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Flow 'volume_create_manager' (ffce2e07-24f6-49c5-a59e-60166a4a11b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-95dde3d1-377e-4926-90d9-47ecbc2b92f3 1073741824" returned: 0 in 0.664s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-95dde3d1-377e-4926-90d9-47ecbc2b92f3 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:23 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-c7e50624-43b0-4af6-8f9d-e8691ad94221 tempest-CreateVolumesFromImageTest-236762478 None] Created volume successfully. Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-95dde3d1-377e-4926-90d9-47ecbc2b92f3" returned: 0 in 0.304s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] <== create_volume: return (998ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.979s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2014794973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59dbdd92-b00a-4a1d-b83d-dd538be24278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d65ddf7c9194c9683c36f4b51ea8fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:18Z,use_quota=True,user_id='5e3ed5e48e514539b25b3d8efdaa540d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Creating volume 59dbdd92-b00a-4a1d-b83d-dd538be24278 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:42:23 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-59dbdd92-b00a-4a1d-b83d-dd538be24278 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:23 devstack quobyte-client[83313]: System call of process 100177 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:23 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=151, name=volume-59dbdd92-b00a-4a1d-b83d-dd538be24278, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4067af-7aff-4417-8980-dcffce1361f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95dde3d1-377e-4926-90d9-47ecbc2b92f3', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d5a040-fd03-4d68-b2ff-03f311392c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:23 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 22 11:42:23 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Image download 0.00 MB at 0.00 MB/s Sep 22 11:42:24 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Volume volume-95dde3d1-377e-4926-90d9-47ecbc2b92f3 (95dde3d1-377e-4926-90d9-47ecbc2b92f3): created successfully Sep 22 11:42:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d5a040-fd03-4d68-b2ff-03f311392c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Flow 'volume_create_manager' (66edea1d-5640-4764-a81f-b5a34232ecf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:24 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-df8b9e91-ac79-4782-9aa2-9677a4ea01d7 tempest-CreateVolumesFromImageTest-236762478 None] Created volume successfully. Sep 22 11:42:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-59dbdd92-b00a-4a1d-b83d-dd538be24278 1073741824" returned: 0 in 0.631s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-59dbdd92-b00a-4a1d-b83d-dd538be24278 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:24 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b56c21-549e-449f-a025-9f25f2d8918d]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:42:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-59dbdd92-b00a-4a1d-b83d-dd538be24278" returned: 0 in 0.307s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] <== create_volume: return (1027ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:42:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.081s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (818913e8-bc43-42a8-9c58-e3ece9eb0f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59dbdd92-b00a-4a1d-b83d-dd538be24278', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f6f5d0-432e-4c5f-aee6-6dcbcfa0a1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] Creating offline snapshot 521fc8fe-86c7-4bd3-b0a5-29216e6b0de1 of volume ca1bfd7c-26a8-403c-a0aa-7b63b285b126 {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:42:24 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Volume volume-59dbdd92-b00a-4a1d-b83d-dd538be24278 (59dbdd92-b00a-4a1d-b83d-dd538be24278): created successfully Sep 22 11:42:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f6f5d0-432e-4c5f-aee6-6dcbcfa0a1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Flow 'volume_create_manager' (fcec20c1-307a-4fee-94cd-bca9cd261a9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:24 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8db79a6-5874-4a1a-8710-9960efa5414a]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:42:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:25 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD Sep 22 11:42:25 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 11:42:25 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-0d8d3ad0-1d17-449d-9714-f95b95775801 tempest-CreateVolumesFromImageTest-236762478 None] Created volume successfully. Sep 22 11:42:25 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "cinder-59dbdd92-b00a-4a1d-b83d-dd538be24278-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:25 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-59dbdd92-b00a-4a1d-b83d-dd538be24278-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:25 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:25 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "cinder-quobyte-59dbdd92-b00a-4a1d-b83d-dd538be24278" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:25 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-quobyte-59dbdd92-b00a-4a1d-b83d-dd538be24278" acquired by "delete_volume" :: waited 0.016s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:25 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bde103-6e7f-4ad0-9add-10c341857472]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:42:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-59dbdd92-b00a-4a1d-b83d-dd538be24278 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:25 devstack quobyte-client[83313]: System call of process 100182 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:25 devstack quobyte-client[83313]: System call of process 100182 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126" returned: 0 in 1.094s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.521fc8fe-86c7-4bd3-b0a5-29216e6b0de1 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:26 devstack quobyte-client[83313]: System call of process 100188 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:26 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=152, name=volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.521fc8fe-86c7-4bd3-b0a5-29216e6b0de1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:42:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-59dbdd92-b00a-4a1d-b83d-dd538be24278" returned: 0 in 0.736s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-59dbdd92-b00a-4a1d-b83d-dd538be24278 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.521fc8fe-86c7-4bd3-b0a5-29216e6b0de1 1G" returned: 0 in 0.658s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.521fc8fe-86c7-4bd3-b0a5-29216e6b0de1 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:26 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-59dbdd92-b00a-4a1d-b83d-dd538be24278" returned: 0 in 0.271s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:26 devstack quobyte-client[83313]: System call of process 100194 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:26 devstack quobyte-client[83313]: System call of process 100194 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:26 devstack quobyte-client[83313]: System call of process 100194 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "qemu-img rebase -u -b volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.521fc8fe-86c7-4bd3-b0a5-29216e6b0de1" returned: 0 in 0.268s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.521fc8fe-86c7-4bd3-b0a5-29216e6b0de1 is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:42:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.521fc8fe-86c7-4bd3-b0a5-29216e6b0de1 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:27 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-quobyte-59dbdd92-b00a-4a1d-b83d-dd538be24278" released by "delete_volume" :: held 1.411s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:42:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.521fc8fe-86c7-4bd3-b0a5-29216e6b0de1" returned: 0 in 0.568s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:27 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126 -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:42:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.521fc8fe-86c7-4bd3-b0a5-29216e6b0de1 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:27 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Sep 22 11:42:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD" returned: 0 in 3.743s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.521fc8fe-86c7-4bd3-b0a5-29216e6b0de1" returned: 0 in 0.538s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:28 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD Sep 22 11:42:28 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 11:42:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.info" returned: 0 in 0.372s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:28 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:42:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:28 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] Created reservations ['a792f01d-29e4-41e0-830b-708e53683e78', '73ec3ab5-840c-4c7c-a932-460a4bbf1c9c', '929008d1-fd6c-41f2-9685-d05f3993c88d', '014c240e-71a2-4f8b-bdda-20683aae3ed5'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:42:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.info" returned: 0 in 0.334s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.424s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:29 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-202da119-7b03-47bf-8277-1646310540cf tempest-CreateVolumesFromSnapshotTest-1543696716 None] Create snapshot completed successfully Sep 22 11:42:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.194s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:29 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:42:29 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] Deleted volume successfully. Sep 22 11:42:30 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "cinder-95dde3d1-377e-4926-90d9-47ecbc2b92f3-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:30 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-63360f68-47a4-4e8c-8ecc-f2d275cba4db tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-59dbdd92-b00a-4a1d-b83d-dd538be24278-delete_volume" released by "delete_volume" :: held 4.692s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:42:30 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-95dde3d1-377e-4926-90d9-47ecbc2b92f3-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:30 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:30 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "cinder-quobyte-95dde3d1-377e-4926-90d9-47ecbc2b92f3" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:30 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-quobyte-95dde3d1-377e-4926-90d9-47ecbc2b92f3" acquired by "delete_volume" :: waited 0.041s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:30 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e82364f-f761-4cbf-b507-03f349fbcb85]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:42:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-95dde3d1-377e-4926-90d9-47ecbc2b92f3 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:31 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:31 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:42:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Flow 'volume_create_manager' (c785304a-0645-4c13-aba6-946f71ae30ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46206ca6-8c17-43b7-b877-8f4fc9e24cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:31 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Sep 22 11:42:31 devstack quobyte-client[83313]: System call of process 100211 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:31 devstack quobyte-client[83313]: System call of process 100211 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:31 devstack quobyte-client[83313]: System call of process 100211 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46206ca6-8c17-43b7-b877-8f4fc9e24cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1713861904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171a2005-295b-495b-b233-6f219b4938dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed8de623bcee486b8c8e1d780c8026d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:30Z,use_quota=True,user_id='a634bf15a9e44bd88b931854c7cd3f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637fb628-8e43-4132-8df0-f1a733ae06a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637fb628-8e43-4132-8df0-f1a733ae06a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92bf317-9f06-4e26-9156-7c791a7b1413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92bf317-9f06-4e26-9156-7c791a7b1413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '171a2005-295b-495b-b233-6f219b4938dc', 'volume_name': 'volume-171a2005-295b-495b-b233-6f219b4938dc', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3614d057-14b6-4a14-a59a-a979dc0b5ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3614d057-14b6-4a14-a59a-a979dc0b5ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:31 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d0b4b1-f374-4a37-9d52-61a01927d7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:31 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume 171a2005-295b-495b-b233-6f219b4938dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-171a2005-295b-495b-b233-6f219b4938dc', 'volume_size': 1} Sep 22 11:42:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1713861904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171a2005-295b-495b-b233-6f219b4938dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed8de623bcee486b8c8e1d780c8026d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:30Z,use_quota=True,user_id='a634bf15a9e44bd88b931854c7cd3f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Creating volume 171a2005-295b-495b-b233-6f219b4938dc {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:42:32 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-171a2005-295b-495b-b233-6f219b4938dc 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:32 devstack quobyte-client[83313]: System call of process 100214 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:32 devstack quobyte-client[83313]: System call of process 100214 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:32 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=154, name=volume-171a2005-295b-495b-b233-6f219b4938dc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD" returned: 1 in 4.410s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Temporary image 2fc8709f-dffd-4783-b17e-a40e5a8794f7 is fetched for user 2619d76b5dfe4913b48dec1469cf5b93. {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 22 11:42:32 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Flow 'volume_create_manager' (9ebf7f1d-40c9-4f8a-b601-ca77c9abb118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6cf802-88b9-430a-8a95-83a6c5da187b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-95dde3d1-377e-4926-90d9-47ecbc2b92f3" returned: 0 in 2.254s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6cf802-88b9-430a-8a95-83a6c5da187b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1806817510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6d1ae3-e72a-479a-9d54-9fcf2b166023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed8de623bcee486b8c8e1d780c8026d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:31Z,use_quota=True,user_id='a634bf15a9e44bd88b931854c7cd3f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc82dde-e778-474e-8f54-2ef59f6bae25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc82dde-e778-474e-8f54-2ef59f6bae25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5bb6df-c830-443a-ac07-768f7546501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5bb6df-c830-443a-ac07-768f7546501c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe6d1ae3-e72a-479a-9d54-9fcf2b166023', 'volume_name': 'volume-fe6d1ae3-e72a-479a-9d54-9fcf2b166023', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f482f39-b588-46ad-9723-319dffbd030b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f482f39-b588-46ad-9723-319dffbd030b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf39743-c275-403a-a34f-e1bbecbe9c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:32 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume fe6d1ae3-e72a-479a-9d54-9fcf2b166023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe6d1ae3-e72a-479a-9d54-9fcf2b166023', 'volume_size': 1} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:32 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Flow 'volume_create_manager' (641965eb-803d-4390-8197-23c25ae97960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:32 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfdcc3dd-923e-48e2-b3df-469fc54cc9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-95dde3d1-377e-4926-90d9-47ecbc2b92f3 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-171a2005-295b-495b-b233-6f219b4938dc 1073741824" returned: 0 in 1.418s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-171a2005-295b-495b-b233-6f219b4938dc {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:33 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:33 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:42:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Flow 'volume_create_manager' (e2780b22-b6cc-4a54-b1d7-adf5e6418f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c8d997-3ae1-4c53-ac50-40c5f5167d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c8d997-3ae1-4c53-ac50-40c5f5167d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1607692137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a552f018-5216-41a2-b0c9-b6d62b58efb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed8de623bcee486b8c8e1d780c8026d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:32Z,use_quota=True,user_id='a634bf15a9e44bd88b931854c7cd3f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392263d1-6e79-42e0-b520-a4ed509b7dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392263d1-6e79-42e0-b520-a4ed509b7dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968fc86d-a5fc-4c34-9572-81741e3c3b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968fc86d-a5fc-4c34-9572-81741e3c3b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a552f018-5216-41a2-b0c9-b6d62b58efb3', 'volume_name': 'volume-a552f018-5216-41a2-b0c9-b6d62b58efb3', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (163a0f72-8a11-4644-90c4-70a42f5c39ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:33 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (163a0f72-8a11-4644-90c4-70a42f5c39ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9992c4-5798-4385-9fc7-dc6a4b7ca433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:34 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume a552f018-5216-41a2-b0c9-b6d62b58efb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a552f018-5216-41a2-b0c9-b6d62b58efb3', 'volume_size': 1} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:34 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Flow 'volume_create_manager' (b96e5919-f182-4f58-80d7-50c08455d949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f9c575-2cd1-4aea-b958-344d7ac4db5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfdcc3dd-923e-48e2-b3df-469fc54cc9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1444812499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc340a0b-0ac1-4dfe-97ff-b6716e6477cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed8de623bcee486b8c8e1d780c8026d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:32Z,use_quota=True,user_id='a634bf15a9e44bd88b931854c7cd3f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8610e45-ce48-4236-b80e-0dcdc93b5207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8610e45-ce48-4236-b80e-0dcdc93b5207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0467fd6-e526-4622-8a11-70ea2a3dc4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0467fd6-e526-4622-8a11-70ea2a3dc4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc340a0b-0ac1-4dfe-97ff-b6716e6477cc', 'volume_name': 'volume-cc340a0b-0ac1-4dfe-97ff-b6716e6477cc', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e874fc1-6522-4099-974c-55bdf3655b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e874fc1-6522-4099-974c-55bdf3655b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c182b45a-3934-44a4-bba4-c79007ff12eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:34 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume cc340a0b-0ac1-4dfe-97ff-b6716e6477cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc340a0b-0ac1-4dfe-97ff-b6716e6477cc', 'volume_size': 1} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-95dde3d1-377e-4926-90d9-47ecbc2b92f3" returned: 0 in 1.079s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f9c575-2cd1-4aea-b958-344d7ac4db5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1305339957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cfcf648-fc0a-4903-9413-4f29bacef1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed8de623bcee486b8c8e1d780c8026d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:33Z,use_quota=True,user_id='a634bf15a9e44bd88b931854c7cd3f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0825b518-1114-4211-a41b-a07d06295c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0825b518-1114-4211-a41b-a07d06295c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19db5595-9f07-4bc3-ab0a-27b894943172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19db5595-9f07-4bc3-ab0a-27b894943172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cfcf648-fc0a-4903-9413-4f29bacef1d9', 'volume_name': 'volume-3cfcf648-fc0a-4903-9413-4f29bacef1d9', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15532805-dce1-4290-bf53-368f54464da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15532805-dce1-4290-bf53-368f54464da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6fd7c94-d7cb-43e1-8d5d-3d5e51f1f34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:34 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume 3cfcf648-fc0a-4903-9413-4f29bacef1d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cfcf648-fc0a-4903-9413-4f29bacef1d9', 'volume_size': 1} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-171a2005-295b-495b-b233-6f219b4938dc" returned: 0 in 0.693s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-quobyte-95dde3d1-377e-4926-90d9-47ecbc2b92f3" released by "delete_volume" :: held 3.567s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] <== create_volume: return (2182ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.192s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[058fcbcc-aa14-4ac6-b66f-5f0b33388490]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.246s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1806817510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6d1ae3-e72a-479a-9d54-9fcf2b166023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed8de623bcee486b8c8e1d780c8026d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:31Z,use_quota=True,user_id='a634bf15a9e44bd88b931854c7cd3f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Creating volume fe6d1ae3-e72a-479a-9d54-9fcf2b166023 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:42:34 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fe6d1ae3-e72a-479a-9d54-9fcf2b166023 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:34 devstack quobyte-client[83313]: System call of process 100219 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:34 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=155, name=volume-fe6d1ae3-e72a-479a-9d54-9fcf2b166023, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d0b4b1-f374-4a37-9d52-61a01927d7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-171a2005-295b-495b-b233-6f219b4938dc', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019961df-b627-4010-8c57-163fbc329d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fe6d1ae3-e72a-479a-9d54-9fcf2b166023 1073741824" returned: 0 in 0.655s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fe6d1ae3-e72a-479a-9d54-9fcf2b166023 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:35 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD Sep 22 11:42:35 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 11:42:35 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume volume-171a2005-295b-495b-b233-6f219b4938dc (171a2005-295b-495b-b233-6f219b4938dc): created successfully Sep 22 11:42:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019961df-b627-4010-8c57-163fbc329d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Flow 'volume_create_manager' (c785304a-0645-4c13-aba6-946f71ae30ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fe6d1ae3-e72a-479a-9d54-9fcf2b166023" returned: 0 in 0.483s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:35 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-19e14bb8-bb0e-4de2-b8d3-e29fb96e6079 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Created volume successfully. Sep 22 11:42:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] <== create_volume: return (1190ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:42:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.446s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1607692137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a552f018-5216-41a2-b0c9-b6d62b58efb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed8de623bcee486b8c8e1d780c8026d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:32Z,use_quota=True,user_id='a634bf15a9e44bd88b931854c7cd3f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:42:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Creating volume a552f018-5216-41a2-b0c9-b6d62b58efb3 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:42:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:42:35 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:42:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a552f018-5216-41a2-b0c9-b6d62b58efb3 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:35 devstack quobyte-client[83313]: System call of process 100225 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:35 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=156, name=volume-a552f018-5216-41a2-b0c9-b6d62b58efb3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:42:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf39743-c275-403a-a34f-e1bbecbe9c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe6d1ae3-e72a-479a-9d54-9fcf2b166023', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd57fe3-9180-45a7-9916-af244b2346e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:36 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] Created reservations ['5fd7478e-7540-4652-84ab-c1ced6c0c985', 'c27a7118-93a0-4e9d-a683-38175cb3ed4f', 'f6db9e75-0c50-4dc3-a04d-58199d907313', '86003d3d-7e0c-4889-9d10-6e69cf0903ff'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:42:36 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume volume-fe6d1ae3-e72a-479a-9d54-9fcf2b166023 (fe6d1ae3-e72a-479a-9d54-9fcf2b166023): created successfully Sep 22 11:42:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd57fe3-9180-45a7-9916-af244b2346e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Flow 'volume_create_manager' (9ebf7f1d-40c9-4f8a-b601-ca77c9abb118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a552f018-5216-41a2-b0c9-b6d62b58efb3 1073741824" returned: 0 in 0.749s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a552f018-5216-41a2-b0c9-b6d62b58efb3 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:36 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-96347a8b-1938-4fc6-a815-32127d8230de tempest-CreateVolumesFromSnapshotTest-1543696716 None] Created volume successfully. Sep 22 11:42:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a552f018-5216-41a2-b0c9-b6d62b58efb3" returned: 0 in 0.419s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] <== create_volume: return (1199ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:42:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.623s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1444812499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc340a0b-0ac1-4dfe-97ff-b6716e6477cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed8de623bcee486b8c8e1d780c8026d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:32Z,use_quota=True,user_id='a634bf15a9e44bd88b931854c7cd3f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:42:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Creating volume cc340a0b-0ac1-4dfe-97ff-b6716e6477cc {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:42:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:36 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:42:36 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:42:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-cc340a0b-0ac1-4dfe-97ff-b6716e6477cc 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:36 devstack quobyte-client[83313]: System call of process 100230 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:36 devstack quobyte-client[83313]: System call of process 100230 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:36 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=157, name=volume-cc340a0b-0ac1-4dfe-97ff-b6716e6477cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:42:37 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9992c4-5798-4385-9fc7-dc6a4b7ca433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a552f018-5216-41a2-b0c9-b6d62b58efb3', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:37 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b33719b7-a5aa-4bd1-8f4f-ce84142310e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:37 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "cinder-cf37432b-f3aa-4d07-9baf-8f1881f6f777-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:37 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume volume-a552f018-5216-41a2-b0c9-b6d62b58efb3 (a552f018-5216-41a2-b0c9-b6d62b58efb3): created successfully Sep 22 11:42:37 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b33719b7-a5aa-4bd1-8f4f-ce84142310e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:37 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Flow 'volume_create_manager' (e2780b22-b6cc-4a54-b1d7-adf5e6418f10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-cc340a0b-0ac1-4dfe-97ff-b6716e6477cc 1073741824" returned: 0 in 0.887s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-cc340a0b-0ac1-4dfe-97ff-b6716e6477cc {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.032s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:38 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:38 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Sep 22 11:42:38 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-cf37432b-f3aa-4d07-9baf-8f1881f6f777-delete_volume" acquired by "delete_volume" :: waited 0.671s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:38 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-5eddb825-3760-4506-b13d-6bb33e543668 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Created volume successfully. Sep 22 11:42:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-cc340a0b-0ac1-4dfe-97ff-b6716e6477cc" returned: 0 in 0.768s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD" returned: 0 in 4.111s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:38 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] <== create_volume: return (1704ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:42:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.651s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:38 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1305339957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cfcf648-fc0a-4903-9413-4f29bacef1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed8de623bcee486b8c8e1d780c8026d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:33Z,use_quota=True,user_id='a634bf15a9e44bd88b931854c7cd3f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:42:38 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Creating volume 3cfcf648-fc0a-4903-9413-4f29bacef1d9 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:42:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:38 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:38 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:38 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:42:38 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:42:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3cfcf648-fc0a-4903-9413-4f29bacef1d9 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:39 devstack quobyte-client[83313]: System call of process 100238 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:39 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=158, name=volume-3cfcf648-fc0a-4903-9413-4f29bacef1d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:42:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c182b45a-3934-44a4-bba4-c79007ff12eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc340a0b-0ac1-4dfe-97ff-b6716e6477cc', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7150eef-a96b-405f-8c32-8be875b48a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:39 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD Sep 22 11:42:39 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 22 11:42:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 1.275s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:39 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:42:39 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume volume-cc340a0b-0ac1-4dfe-97ff-b6716e6477cc (cc340a0b-0ac1-4dfe-97ff-b6716e6477cc): created successfully Sep 22 11:42:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7150eef-a96b-405f-8c32-8be875b48a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:39 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Flow 'volume_create_manager' (641965eb-803d-4390-8197-23c25ae97960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:39 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] Deleted volume successfully. Sep 22 11:42:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3cfcf648-fc0a-4903-9413-4f29bacef1d9 1073741824" returned: 0 in 0.650s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:39 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "cinder-quobyte-cf37432b-f3aa-4d07-9baf-8f1881f6f777" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3cfcf648-fc0a-4903-9413-4f29bacef1d9 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:39 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-9df73b92-259b-4380-a504-2273e8198aed tempest-CreateVolumesFromSnapshotTest-1543696716 None] Created volume successfully. Sep 22 11:42:40 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-quobyte-cf37432b-f3aa-4d07-9baf-8f1881f6f777" acquired by "delete_volume" :: waited 0.545s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3cfcf648-fc0a-4903-9413-4f29bacef1d9" returned: 0 in 0.567s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] <== create_volume: return (1295ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:42:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:40 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[273084db-1cd9-422c-843a-7428835634bd]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:42:40 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-334c0ed8-5459-4e22-8ab8-2a8c5a559bbf tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-95dde3d1-377e-4926-90d9-47ecbc2b92f3-delete_volume" released by "delete_volume" :: held 9.834s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:42:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-cf37432b-f3aa-4d07-9baf-8f1881f6f777 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6fd7c94-d7cb-43e1-8d5d-3d5e51f1f34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cfcf648-fc0a-4903-9413-4f29bacef1d9', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5751b5-37d9-4283-b00f-7b77d922af95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:40 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume volume-3cfcf648-fc0a-4903-9413-4f29bacef1d9 (3cfcf648-fc0a-4903-9413-4f29bacef1d9): created successfully Sep 22 11:42:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5751b5-37d9-4283-b00f-7b77d922af95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:40 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Flow 'volume_create_manager' (b96e5919-f182-4f58-80d7-50c08455d949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:40 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-c268b9dd-bf33-4e25-b277-9f3914a5e1be tempest-CreateVolumesFromSnapshotTest-1543696716 None] Created volume successfully. Sep 22 11:42:40 devstack quobyte-client[83313]: System call of process 100243 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:40 devstack quobyte-client[83313]: System call of process 100243 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-cf37432b-f3aa-4d07-9baf-8f1881f6f777" returned: 0 in 0.729s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-cf37432b-f3aa-4d07-9baf-8f1881f6f777 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-cf37432b-f3aa-4d07-9baf-8f1881f6f777" returned: 0 in 0.305s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-quobyte-cf37432b-f3aa-4d07-9baf-8f1881f6f777" released by "delete_volume" :: held 1.370s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:42:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "cinder-3cfcf648-fc0a-4903-9413-4f29bacef1d9-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:41 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 22 11:42:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD" returned: 1 in 3.374s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:42:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9b69f0-a1ca-4677-87d0-e3c698463871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d39ea121a2e4a1caf9bc751a637d495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:42:20Z,use_quota=True,user_id='2619d76b5dfe4913b48dec1469cf5b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:42:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Creating volume 0d9b69f0-a1ca-4677-87d0-e3c698463871 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:42:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:42:41 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:42:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:42 devstack quobyte-client[83313]: System call of process 100250 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:42 devstack quobyte-client[83313]: System call of process 100250 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:42 devstack quobyte-client[83313]: System call of process 100250 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:42 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=159, name=volume-0d9b69f0-a1ca-4677-87d0-e3c698463871, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:42:42 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-3cfcf648-fc0a-4903-9413-4f29bacef1d9-delete_volume" acquired by "delete_volume" :: waited 0.405s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871 1073741824" returned: 0 in 0.498s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:42 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:42 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "cinder-quobyte-3cfcf648-fc0a-4903-9413-4f29bacef1d9" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871" returned: 0 in 0.445s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:42 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] Created reservations ['4c469f22-5e21-4fd7-9457-eeb66c7c586e', '0410fd0f-e1bf-4e2c-bf7c-8b566835972e', '9c10effa-e1a5-41c7-9cc8-c52709b17352', '33960a3a-404c-43c2-a822-c333786d5324'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:42:42 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] <== create_volume: return (1000ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:42:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:42 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-quobyte-3cfcf648-fc0a-4903-9413-4f29bacef1d9" acquired by "delete_volume" :: waited 0.148s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:42 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Attempting download of 2fc8709f-dffd-4783-b17e-a40e5a8794f7 ((None, [{'url': 'file:///opt/stack/data/glance/images/2fc8709f-dffd-4783-b17e-a40e5a8794f7', 'metadata': {}}])) to volume 0d9b69f0-a1ca-4677-87d0-e3c698463871. {{(pid=83310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 22 11:42:43 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6e3ea7-653d-4cfe-bbc7-2cf46c419532]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:42:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3cfcf648-fc0a-4903-9413-4f29bacef1d9 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:43 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b6a2a5-815b-4832-be5a-12e2cc12af2c]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:42:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fc8709f-dffd-4783-b17e-a40e5a8794f7__ep922eg {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:43 devstack quobyte-client[83313]: System call of process 100254 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:43 devstack quobyte-client[83313]: System call of process 100254 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:43 devstack quobyte-client[83313]: System call of process 100254 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3cfcf648-fc0a-4903-9413-4f29bacef1d9" returned: 0 in 0.736s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3cfcf648-fc0a-4903-9413-4f29bacef1d9 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-3cfcf648-fc0a-4903-9413-4f29bacef1d9" returned: 0 in 0.228s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-quobyte-3cfcf648-fc0a-4903-9413-4f29bacef1d9" released by "delete_volume" :: held 1.546s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:42:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "cinder-9c17bf28-c726-479a-ad2b-49223b621b43-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fc8709f-dffd-4783-b17e-a40e5a8794f7__ep922eg" returned: 0 in 1.283s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fc8709f-dffd-4783-b17e-a40e5a8794f7__ep922eg {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.975s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:45 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:42:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-9c17bf28-c726-479a-ad2b-49223b621b43-delete_volume" acquired by "delete_volume" :: waited 0.548s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:45 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] Deleted volume successfully. Sep 22 11:42:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fc8709f-dffd-4783-b17e-a40e5a8794f7__ep922eg" returned: 1 in 0.608s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fc8709f-dffd-4783-b17e-a40e5a8794f7__ep922eg' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:42:45 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecde573b-3e7e-4348-a55e-c7be045297b3]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:42:45 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-53020001-0986-4e13-bc36-981c499bcc2b tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-cf37432b-f3aa-4d07-9baf-8f1881f6f777-delete_volume" released by "delete_volume" :: held 7.537s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:42:45 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:45 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "cinder-quobyte-9c17bf28-c726-479a-ad2b-49223b621b43" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:46 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-quobyte-9c17bf28-c726-479a-ad2b-49223b621b43" acquired by "delete_volume" :: waited 0.077s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:46 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] Created reservations ['bfb5fd18-76b5-46fd-8d6d-12ce903a3bd7', 'ff2a1a26-9de5-4ab6-8ed4-b9ce41ada5df', 'ba627da1-1905-41d4-8c41-7023c2c3db8e', '121b5ef0-3f86-49ad-be73-c35fd5ca185e'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:42:46 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45bbec3-f636-4113-a1ca-86fba2160fb8]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:42:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-9c17bf28-c726-479a-ad2b-49223b621b43 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD" returned: 0 in 0.884s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:46 devstack quobyte-client[83313]: System call of process 100265 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:46 devstack quobyte-client[83313]: System call of process 100265 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:46 devstack quobyte-client[83313]: System call of process 100265 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:46 devstack quobyte-client[83313]: System call of process 100265 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-9c17bf28-c726-479a-ad2b-49223b621b43" returned: 0 in 0.778s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:46 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-9c17bf28-c726-479a-ad2b-49223b621b43 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:47 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:47 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "cinder-a552f018-5216-41a2-b0c9-b6d62b58efb3-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD" returned: 1 in 1.246s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:42:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-9c17bf28-c726-479a-ad2b-49223b621b43" returned: 0 in 0.758s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:47 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] 2fc8709f-dffd-4783-b17e-a40e5a8794f7 was raw, converting to raw {{(pid=83310) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 22 11:42:47 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:47 devstack quobyte-client[83313]: System call of process 100274 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:47 devstack quobyte-client[83313]: System call of process 100274 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-a552f018-5216-41a2-b0c9-b6d62b58efb3-delete_volume" acquired by "delete_volume" :: waited 0.487s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:48 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=159, name=volume-0d9b69f0-a1ca-4677-87d0-e3c698463871, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:42:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-quobyte-9c17bf28-c726-479a-ad2b-49223b621b43" released by "delete_volume" :: held 2.228s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:42:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.857s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:48 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:42:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871" returned: 0 in 0.556s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:48 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2fc8709f-dffd-4783-b17e-a40e5a8794f7_8gaqswqxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871 {{(pid=83310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 22 11:42:48 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Converted 0.00 MB image at 0.00 MB/s Sep 22 11:42:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:48 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] Deleted volume successfully. Sep 22 11:42:48 devstack quobyte-client[83313]: System call of process 100277 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:48 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "cinder-quobyte-a552f018-5216-41a2-b0c9-b6d62b58efb3" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:48 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871 1G" returned: 0 in 0.553s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:48 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e49fe254-b590-4223-a586-91e54d02f1ce tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-3cfcf648-fc0a-4903-9413-4f29bacef1d9-delete_volume" released by "delete_volume" :: held 6.805s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:42:49 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-quobyte-a552f018-5216-41a2-b0c9-b6d62b58efb3" acquired by "delete_volume" :: waited 0.159s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:49 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4f57d5-a190-49a0-8bdb-22916505dc9a]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:42:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:49 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f026f78-36f8-4f40-aa44-ddb1ef89b0e0]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:42:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a552f018-5216-41a2-b0c9-b6d62b58efb3 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:49 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] Created reservations ['fe583a46-4d7d-4707-95ec-d780cdccab72', '2b89c5de-f1a4-4605-ab63-efbc1a04b953', 'b40c4eea-2b6a-4fd8-977d-75b3326ed662', '99ecda72-fad7-4c4f-a33e-cc0e30d3b423'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:42:49 devstack quobyte-client[83313]: System call of process 100281 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871" returned: 0 in 0.724s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:49 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:49 devstack quobyte-client[83313]: System call of process 100282 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:49 devstack quobyte-client[83313]: System call of process 100282 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:49 devstack quobyte-client[83313]: System call of process 100282 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:49 devstack quobyte-client[83313]: System call of process 100282 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "cinder-9914b286-11c5-4ffd-8dba-be76aa6dd130-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a552f018-5216-41a2-b0c9-b6d62b58efb3" returned: 0 in 1.136s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a552f018-5216-41a2-b0c9-b6d62b58efb3 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:50 devstack quobyte-client[83313]: System call of process 100284 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:50 devstack quobyte-client[83313]: System call of process 100284 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:50 devstack quobyte-client[83313]: System call of process 100284 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:50 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-9914b286-11c5-4ffd-8dba-be76aa6dd130-delete_volume" acquired by "delete_volume" :: waited 0.354s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-a552f018-5216-41a2-b0c9-b6d62b58efb3" returned: 0 in 0.491s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871" returned: 1 in 1.073s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:50 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:42:50 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Downloaded image 2fc8709f-dffd-4783-b17e-a40e5a8794f7 ((None, [{'url': 'file:///opt/stack/data/glance/images/2fc8709f-dffd-4783-b17e-a40e5a8794f7', 'metadata': {}}])) to volume 0d9b69f0-a1ca-4677-87d0-e3c698463871 successfully. {{(pid=83310) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 22 11:42:50 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Temporary image 2fc8709f-dffd-4783-b17e-a40e5a8794f7 for user 2619d76b5dfe4913b48dec1469cf5b93 is deleted. {{(pid=83310) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 22 11:42:50 devstack cinder-volume[83310]: DEBUG cinder.volume.volume_utils [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Marking volume 0d9b69f0-a1ca-4677-87d0-e3c698463871 as bootable. {{(pid=83310) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 22 11:42:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:51 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:51 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-quobyte-a552f018-5216-41a2-b0c9-b6d62b58efb3" released by "delete_volume" :: held 2.342s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:42:51 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Copying metadata from image 2fc8709f-dffd-4783-b17e-a40e5a8794f7 to 0d9b69f0-a1ca-4677-87d0-e3c698463871. {{(pid=83310) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 22 11:42:51 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Creating volume glance metadata for volume 0d9b69f0-a1ca-4677-87d0-e3c698463871 backed by image 2fc8709f-dffd-4783-b17e-a40e5a8794f7 with: {'image_id': '2fc8709f-dffd-4783-b17e-a40e5a8794f7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3b6e3781a80c9318033d1ffb81a964cb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83310) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 22 11:42:51 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:51 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "cinder-quobyte-9914b286-11c5-4ffd-8dba-be76aa6dd130" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.660s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:51 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:42:51 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] Deleted volume successfully. Sep 22 11:42:51 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-quobyte-9914b286-11c5-4ffd-8dba-be76aa6dd130" acquired by "delete_volume" :: waited 0.153s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:51 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[5155c6c6-f060-49fb-881d-40a917df8e15]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:42:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-9914b286-11c5-4ffd-8dba-be76aa6dd130 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:52 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-cae5ce59-2096-471f-bf3d-99136f41073d tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-9c17bf28-c726-479a-ad2b-49223b621b43-delete_volume" released by "delete_volume" :: held 7.030s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:42:52 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Created reservations ['ef9237f5-498c-4f18-9e64-170aa9a878a4', 'da4d472b-42d1-486e-a787-43ed6799be99', 'ce104b3a-e5eb-4fbe-bbdb-d2b423e918dc', '77d1f96e-4ca1-45a5-9fd3-6bc073b4dac0'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:42:52 devstack quobyte-client[83313]: System call of process 100292 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:52 devstack quobyte-client[83313]: System call of process 100292 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:52 devstack quobyte-client[83313]: System call of process 100292 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73a0b98-1286-4354-b200-8e489424192b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d9b69f0-a1ca-4677-87d0-e3c698463871', 'volume_size': 1, 'image_id': '2fc8709f-dffd-4783-b17e-a40e5a8794f7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fc8709f-dffd-4783-b17e-a40e5a8794f7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b6e3781a80c9318033d1ffb81a964cb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6d39ea121a2e4a1caf9bc751a637d495', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f37d6aedf45908a8b17622fd3c75db34ce50760d3012c84252fb3aca4a3f8cc671fec6215a1ea03db9b2ee8021359ac638d077d70dc4251dc3117f0839033c53', 'id': '2fc8709f-dffd-4783-b17e-a40e5a8794f7', 'created_at': datetime.datetime(2025, 9, 22, 9, 42, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 22, 9, 42, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fc8709f-dffd-4783-b17e-a40e5a8794f7/file', 'properties': {}}, 'image_service': }' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b7268c-ad2b-4970-a8b4-d9ea93218639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:42:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-9914b286-11c5-4ffd-8dba-be76aa6dd130" returned: 0 in 0.937s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-9914b286-11c5-4ffd-8dba-be76aa6dd130 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:53 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Volume volume-0d9b69f0-a1ca-4677-87d0-e3c698463871 (0d9b69f0-a1ca-4677-87d0-e3c698463871): created successfully Sep 22 11:42:53 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b7268c-ad2b-4970-a8b4-d9ea93218639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:42:53 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Flow 'volume_create_manager' (2567e91a-1e34-4bd9-ab29-910f09436646) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:42:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-9914b286-11c5-4ffd-8dba-be76aa6dd130" returned: 0 in 0.428s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:53 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-44d5e81e-998b-4358-875e-353d34a60436 tempest-VolumeImageDependencyTests-1471029950 None] Created volume successfully. Sep 22 11:42:53 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-quobyte-9914b286-11c5-4ffd-8dba-be76aa6dd130" released by "delete_volume" :: held 1.532s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:42:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:53 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:53 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] Acquiring lock "cinder-0d9b69f0-a1ca-4677-87d0-e3c698463871-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.519s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "cinder-cc340a0b-0ac1-4dfe-97ff-b6716e6477cc-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:54 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:42:54 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Deleted volume successfully. Sep 22 11:42:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] Lock "cinder-0d9b69f0-a1ca-4677-87d0-e3c698463871-delete_volume" acquired by "delete_volume" :: waited 0.190s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-cc340a0b-0ac1-4dfe-97ff-b6716e6477cc-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:54 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] Created reservations ['7d67bbd4-b610-4129-b374-441b87e0cf95', 'e7d4b6ae-aec1-481b-a47e-742ac693a61e', '2492ac0c-b1df-422c-815d-7a2166cf6428', '41540194-016d-4210-88a3-64faf94e9889'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:42:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-45232ca2-c6d4-42d9-9b5f-ae58d2aa2ec7 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-a552f018-5216-41a2-b0c9-b6d62b58efb3-delete_volume" released by "delete_volume" :: held 6.222s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:42:54 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "cinder-quobyte-cc340a0b-0ac1-4dfe-97ff-b6716e6477cc" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-quobyte-cc340a0b-0ac1-4dfe-97ff-b6716e6477cc" acquired by "delete_volume" :: waited 0.030s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:54 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51b2794-7de7-4490-839d-bd5137b91547]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:42:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-cc340a0b-0ac1-4dfe-97ff-b6716e6477cc {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:54 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] Acquiring lock "cinder-quobyte-0d9b69f0-a1ca-4677-87d0-e3c698463871" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.299s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-cc340a0b-0ac1-4dfe-97ff-b6716e6477cc" returned: 0 in 0.831s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:55 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:42:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-cc340a0b-0ac1-4dfe-97ff-b6716e6477cc {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] Lock "cinder-quobyte-0d9b69f0-a1ca-4677-87d0-e3c698463871" acquired by "delete_volume" :: waited 0.641s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:55 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d6d21d-2122-4334-8f1d-659f50014176]: (4, 'raw') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:42:55 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] Deleted volume successfully. Sep 22 11:42:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-cc340a0b-0ac1-4dfe-97ff-b6716e6477cc" returned: 0 in 0.721s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-f36f6693-e64a-4411-9f89-e7288d5b292b tempest-CreateVolumesFromImageTest-236762478 None] Lock "cinder-9914b286-11c5-4ffd-8dba-be76aa6dd130-delete_volume" released by "delete_volume" :: held 5.530s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:42:56 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-quobyte-cc340a0b-0ac1-4dfe-97ff-b6716e6477cc" released by "delete_volume" :: held 1.780s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:42:56 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Created reservations ['1d876903-33db-464a-9087-e9c9a2f7e2de', 'ed1bb6fd-5a63-433a-be1c-ccce84475f10', '13c57634-eeba-44ec-a5df-26c566261345', '0a8776d9-8d33-4e9e-8542-69df27f1d4dc'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:42:56 devstack quobyte-client[83313]: System call of process 100302 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:56 devstack quobyte-client[83313]: System call of process 100302 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871" returned: 0 in 0.846s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:57 devstack quobyte-client[83313]: System call of process 100305 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.161s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:57 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:42:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871" returned: 1 in 0.888s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871' failed. Not Retrying. {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 22 11:42:57 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Deleted volume successfully. Sep 22 11:42:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "cinder-fe6d1ae3-e72a-479a-9d54-9fcf2b166023-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0d9b69f0-a1ca-4677-87d0-e3c698463871" returned: 0 in 0.381s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:42:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a2e5e507-93af-4a97-8530-db1804f03d40 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-cc340a0b-0ac1-4dfe-97ff-b6716e6477cc-delete_volume" released by "delete_volume" :: held 3.847s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:42:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] Lock "cinder-quobyte-0d9b69f0-a1ca-4677-87d0-e3c698463871" released by "delete_volume" :: held 2.622s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:42:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-fe6d1ae3-e72a-479a-9d54-9fcf2b166023-delete_volume" acquired by "delete_volume" :: waited 0.274s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:58 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] Created reservations ['f7981f4e-05fd-4586-a209-5caa244a38c2', '2735972f-e3d2-4f4a-8696-4889ec64907a', 'b230b976-892c-4329-aef1-e8489ab470b0', 'd582e24a-8bc7-42a9-ae5d-ac9ce512b763'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:42:58 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:42:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "cinder-quobyte-fe6d1ae3-e72a-479a-9d54-9fcf2b166023" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:42:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-quobyte-fe6d1ae3-e72a-479a-9d54-9fcf2b166023" acquired by "delete_volume" :: waited 0.039s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:42:58 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c6249b-2773-4c60-90ef-a792c455b69d]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:42:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fe6d1ae3-e72a-479a-9d54-9fcf2b166023 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:59 devstack quobyte-client[83313]: System call of process 100323 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:42:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:42:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:42:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:42:59 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:42:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:42:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:42:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fe6d1ae3-e72a-479a-9d54-9fcf2b166023" returned: 0 in 1.268s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fe6d1ae3-e72a-479a-9d54-9fcf2b166023 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.417s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:00 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:43:00 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] Deleted volume successfully. Sep 22 11:43:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-fe6d1ae3-e72a-479a-9d54-9fcf2b166023" returned: 0 in 0.620s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:00 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-quobyte-fe6d1ae3-e72a-479a-9d54-9fcf2b166023" released by "delete_volume" :: held 2.136s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:00 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-6cb9f133-4129-4181-986f-9d97e7b54055 tempest-VolumeImageDependencyTests-1471029950 None] Lock "cinder-0d9b69f0-a1ca-4677-87d0-e3c698463871-delete_volume" released by "delete_volume" :: held 6.512s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:00 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] Created reservations ['f50ec9d0-a38f-492d-9358-a8cc839b6e87', 'ac425c4d-b0c3-46d8-b246-d8a6fbe6872c', 'd06ccef3-7e96-4ad9-8e1c-1b2c050e595c', 'adabb95a-57c5-4369-aacd-faf6bb8dedb3'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:43:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:01 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:01 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.208s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:01 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:43:01 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] Deleted volume successfully. Sep 22 11:43:01 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "cinder-171a2005-295b-495b-b233-6f219b4938dc-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-171a2005-295b-495b-b233-6f219b4938dc-delete_volume" acquired by "delete_volume" :: waited 0.553s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-9dd9c7ec-4762-4e31-87f8-468ae908549a tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-fe6d1ae3-e72a-479a-9d54-9fcf2b166023-delete_volume" released by "delete_volume" :: held 4.241s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:02 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "cinder-quobyte-171a2005-295b-495b-b233-6f219b4938dc" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-quobyte-171a2005-295b-495b-b233-6f219b4938dc" acquired by "delete_volume" :: waited 0.011s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:02 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb71c60f-215d-4421-8da1-3c29163084a4]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:43:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-171a2005-295b-495b-b233-6f219b4938dc {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:03 devstack quobyte-client[83313]: System call of process 100355 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-171a2005-295b-495b-b233-6f219b4938dc" returned: 0 in 0.608s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-171a2005-295b-495b-b233-6f219b4938dc {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-171a2005-295b-495b-b233-6f219b4938dc" returned: 0 in 0.167s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-quobyte-171a2005-295b-495b-b233-6f219b4938dc" released by "delete_volume" :: held 1.052s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:03 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] Created reservations ['fc934156-6dcf-40d2-acea-58009a57bfa5', 'ea8bc2a7-3140-4ad3-82e0-1f9257df8b92', 'e3b7bd83-5d1e-427f-8729-6f2c43b9b2eb', '6d748238-82ae-41a5-ab67-ee5b93eae18c'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:43:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.169s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:04 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:43:04 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] Deleted volume successfully. Sep 22 11:43:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-78feb220-a873-4781-b896-3bf2e8b4cb2d tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-171a2005-295b-495b-b233-6f219b4938dc-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:05 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "cinder-521fc8fe-86c7-4bd3-b0a5-29216e6b0de1-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:05 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-521fc8fe-86c7-4bd3-b0a5-29216e6b0de1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:05 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:05 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "cinder-quobyte-ca1bfd7c-26a8-403c-a0aa-7b63b285b126" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:05 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-quobyte-ca1bfd7c-26a8-403c-a0aa-7b63b285b126" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:05 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "cinder-quobyte-521fc8fe-86c7-4bd3-b0a5-29216e6b0de1" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:05 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-quobyte-521fc8fe-86c7-4bd3-b0a5-29216e6b0de1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:05 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Deleting offline snapshot 521fc8fe-86c7-4bd3-b0a5-29216e6b0de1 of volume ca1bfd7c-26a8-403c-a0aa-7b63b285b126 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:43:05 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] snapshot_file for this snap is: volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.521fc8fe-86c7-4bd3-b0a5-29216e6b0de1 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:43:05 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed989c7-1664-485a-a337-35f117537b45]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:43:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.521fc8fe-86c7-4bd3-b0a5-29216e6b0de1 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:05 devstack quobyte-client[83313]: System call of process 100360 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:05 devstack quobyte-client[83313]: System call of process 100360 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:05 devstack quobyte-client[83313]: System call of process 100360 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.521fc8fe-86c7-4bd3-b0a5-29216e6b0de1" returned: 0 in 0.455s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:05 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:43:05 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb6d83c-c334-4f16-919a-e6a73256befd]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:43:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126" returned: 0 in 0.461s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.521fc8fe-86c7-4bd3-b0a5-29216e6b0de1 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:06 devstack quobyte-client[83313]: System call of process 100367 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:06 devstack quobyte-client[83313]: System call of process 100367 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.521fc8fe-86c7-4bd3-b0a5-29216e6b0de1" returned: 0 in 0.361s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.521fc8fe-86c7-4bd3-b0a5-29216e6b0de1 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:06 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126.521fc8fe-86c7-4bd3-b0a5-29216e6b0de1" returned: 0 in 0.118s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:07 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-quobyte-521fc8fe-86c7-4bd3-b0a5-29216e6b0de1" released by "_delete_snapshot" :: held 1.882s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:07 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-quobyte-ca1bfd7c-26a8-403c-a0aa-7b63b285b126" released by "delete_snapshot" :: held 1.909s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:07 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Created reservations ['2cf62d10-d24e-4945-9664-97780b1252d8', 'b0899eb4-925f-404f-8404-32990d586f21', 'af2532e8-2441-4006-8f6a-abf27edbf37e', '8f855969-240e-413f-92fd-3fa97508db12'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:43:07 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Delete snapshot completed successfully. Sep 22 11:43:07 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-38ad1c29-6b87-4e31-a468-4012ab7731e0 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-521fc8fe-86c7-4bd3-b0a5-29216e6b0de1-delete_snapshot" released by "delete_snapshot" :: held 2.458s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:08 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "cinder-ca1bfd7c-26a8-403c-a0aa-7b63b285b126-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:08 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-ca1bfd7c-26a8-403c-a0aa-7b63b285b126-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:08 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=125,cinder:SELECT=77,cinder:DELETE=10,cinder:INSERT=24 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:43:08 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=81,cinder:UPDATE=116,cinder:DELETE=14,cinder:INSERT=33 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:43:08 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:08 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "cinder-quobyte-ca1bfd7c-26a8-403c-a0aa-7b63b285b126" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:08 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-quobyte-ca1bfd7c-26a8-403c-a0aa-7b63b285b126" acquired by "delete_volume" :: waited 0.014s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:08 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae3100e-ad15-4d01-9aa6-835dc287c2b6]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:43:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:09 devstack quobyte-client[83313]: System call of process 100371 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:09 devstack quobyte-client[83313]: System call of process 100371 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126" returned: 0 in 0.558s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-ca1bfd7c-26a8-403c-a0aa-7b63b285b126" returned: 0 in 0.138s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:09 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-quobyte-ca1bfd7c-26a8-403c-a0aa-7b63b285b126" released by "delete_volume" :: held 0.997s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:09 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Created reservations ['2fa53451-fbf9-4e72-8320-5fc6e885eacd', 'f405497e-cb16-4e35-83b5-be9c232dfa6d', '998592a8-4054-47ee-bb97-164a9889ad4f', '4e3c9495-de9b-49b7-af37-0579a3b126d2'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:43:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:10 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:10 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.121s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:10 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:43:10 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Deleted volume successfully. Sep 22 11:43:10 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2cb89bce-ec47-496c-bc3f-0630b4ea8d97 tempest-CreateVolumesFromSnapshotTest-1543696716 None] Lock "cinder-ca1bfd7c-26a8-403c-a0aa-7b63b285b126-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:15 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:15 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Flow 'volume_create_manager' (928a6d43-a51c-4027-aa34-8505f73f2277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db86ff6-2b32-4897-8760-eeb008b401f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db86ff6-2b32-4897-8760-eeb008b401f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-17909724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b520e65c-f8cd-4b64-abd1-fcadb0408cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b98725d690450dab4f9f44a6941e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:43:16Z,use_quota=True,user_id='2f802c1e7c4f405dbbc6deb7bc6536c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c81994-f20b-427e-8830-09b0eb393e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c81994-f20b-427e-8830-09b0eb393e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef6cf6a-45d0-48f9-8262-4a987126b4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef6cf6a-45d0-48f9-8262-4a987126b4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b520e65c-f8cd-4b64-abd1-fcadb0408cd7', 'volume_name': 'volume-b520e65c-f8cd-4b64-abd1-fcadb0408cd7', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d80c1b-a3e5-445e-aa27-29a2615c515a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d80c1b-a3e5-445e-aa27-29a2615c515a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5278055-c005-445e-98ce-df02e9c4903f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:16 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume b520e65c-f8cd-4b64-abd1-fcadb0408cd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b520e65c-f8cd-4b64-abd1-fcadb0408cd7', 'volume_size': 1} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-17909724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b520e65c-f8cd-4b64-abd1-fcadb0408cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b98725d690450dab4f9f44a6941e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:43:16Z,use_quota=True,user_id='2f802c1e7c4f405dbbc6deb7bc6536c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Creating volume b520e65c-f8cd-4b64-abd1-fcadb0408cd7 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:43:16 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b520e65c-f8cd-4b64-abd1-fcadb0408cd7 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:16 devstack quobyte-client[83313]: System call of process 100377 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:16 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=160, name=volume-b520e65c-f8cd-4b64-abd1-fcadb0408cd7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b520e65c-f8cd-4b64-abd1-fcadb0408cd7 1073741824" returned: 0 in 0.432s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b520e65c-f8cd-4b64-abd1-fcadb0408cd7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b520e65c-f8cd-4b64-abd1-fcadb0408cd7" returned: 0 in 0.160s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] <== create_volume: return (705ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:43:16 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5278055-c005-445e-98ce-df02e9c4903f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b520e65c-f8cd-4b64-abd1-fcadb0408cd7', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a86a7fe-5110-410b-acc8-cfb22cc7c1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:17 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume volume-b520e65c-f8cd-4b64-abd1-fcadb0408cd7 (b520e65c-f8cd-4b64-abd1-fcadb0408cd7): created successfully Sep 22 11:43:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a86a7fe-5110-410b-acc8-cfb22cc7c1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:17 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Flow 'volume_create_manager' (928a6d43-a51c-4027-aa34-8505f73f2277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:17 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-5a14a7bf-b750-4632-9316-c05af6389eb5 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Created volume successfully. Sep 22 11:43:18 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:43:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:19 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Flow 'volume_create_manager' (ab284b2c-7288-47ec-995d-5110a1801127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b263a4-685e-4cbf-aa86-8b6eedb6fc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b263a4-685e-4cbf-aa86-8b6eedb6fc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1692475666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640ba860-d746-4c42-be25-aeae5e252e1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b98725d690450dab4f9f44a6941e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:43:18Z,use_quota=True,user_id='2f802c1e7c4f405dbbc6deb7bc6536c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde02fae-dcaa-487d-9643-6d79442250d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde02fae-dcaa-487d-9643-6d79442250d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a926d1a-29cb-49fb-adb9-df1f7bcad415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a926d1a-29cb-49fb-adb9-df1f7bcad415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '640ba860-d746-4c42-be25-aeae5e252e1f', 'volume_name': 'volume-640ba860-d746-4c42-be25-aeae5e252e1f', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116615bc-1a5e-435d-9d67-42709ca7b98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116615bc-1a5e-435d-9d67-42709ca7b98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32097d7a-7aa0-4e61-bd8c-92fa1f847695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:19 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume 640ba860-d746-4c42-be25-aeae5e252e1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-640ba860-d746-4c42-be25-aeae5e252e1f', 'volume_size': 1} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1692475666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640ba860-d746-4c42-be25-aeae5e252e1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b98725d690450dab4f9f44a6941e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:43:18Z,use_quota=True,user_id='2f802c1e7c4f405dbbc6deb7bc6536c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Creating volume 640ba860-d746-4c42-be25-aeae5e252e1f {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:43:19 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:43:19 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-640ba860-d746-4c42-be25-aeae5e252e1f 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:19 devstack quobyte-client[83313]: System call of process 100383 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:19 devstack quobyte-client[83313]: System call of process 100383 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:19 devstack quobyte-client[83313]: System call of process 100383 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:19 devstack quobyte-client[83313]: System call of process 100383 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:19 devstack quobyte-client[83313]: System call of process 100383 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:19 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=161, name=volume-640ba860-d746-4c42-be25-aeae5e252e1f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:43:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 1.572s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:20 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:43:20 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:20 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:43:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Flow 'volume_create_manager' (c013ba04-094d-4090-b5db-7d893da525bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a2bb37-4a90-4adb-b3b2-e1a968325138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-640ba860-d746-4c42-be25-aeae5e252e1f 1073741824" returned: 0 in 1.226s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:20 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-640ba860-d746-4c42-be25-aeae5e252e1f {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:20 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a2bb37-4a90-4adb-b3b2-e1a968325138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-409268251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afef61e6-9d9b-4a3f-9ddf-979b620730e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b98725d690450dab4f9f44a6941e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:43:19Z,use_quota=True,user_id='2f802c1e7c4f405dbbc6deb7bc6536c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (357beb7d-b61e-4dc6-a76e-483cfc3da327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (357beb7d-b61e-4dc6-a76e-483cfc3da327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2597637-081c-475e-876f-276f89d2eeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2597637-081c-475e-876f-276f89d2eeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afef61e6-9d9b-4a3f-9ddf-979b620730e7', 'volume_name': 'volume-afef61e6-9d9b-4a3f-9ddf-979b620730e7', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5f8d27-4e00-4cfa-add8-72080076fdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5f8d27-4e00-4cfa-add8-72080076fdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299a0406-0571-476f-b405-ab4625340ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:21 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume afef61e6-9d9b-4a3f-9ddf-979b620730e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afef61e6-9d9b-4a3f-9ddf-979b620730e7', 'volume_size': 1} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:21 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Flow 'volume_create_manager' (3f0b8467-9478-4d6a-b8bc-933e90cde0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6aca3d4-490b-4482-9f11-ba8d2c8d1db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:21 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Flow 'volume_create_manager' (b70ba98f-3a2b-4d32-b22d-6f1ba675b827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a5f456-4b76-44c5-88bd-ff01407eca6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-640ba860-d746-4c42-be25-aeae5e252e1f" returned: 0 in 0.764s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] <== create_volume: return (2029ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.040s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.296s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-409268251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afef61e6-9d9b-4a3f-9ddf-979b620730e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b98725d690450dab4f9f44a6941e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:43:19Z,use_quota=True,user_id='2f802c1e7c4f405dbbc6deb7bc6536c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Creating volume afef61e6-9d9b-4a3f-9ddf-979b620730e7 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:43:21 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-afef61e6-9d9b-4a3f-9ddf-979b620730e7 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:21 devstack quobyte-client[83313]: System call of process 100387 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:21 devstack quobyte-client[83313]: System call of process 100387 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:21 devstack quobyte-client[83313]: System call of process 100387 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:21 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=162, name=volume-afef61e6-9d9b-4a3f-9ddf-979b620730e7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6aca3d4-490b-4482-9f11-ba8d2c8d1db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1212157393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae556cf-d7db-4278-a613-e20fb5217ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b98725d690450dab4f9f44a6941e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:43:19Z,use_quota=True,user_id='2f802c1e7c4f405dbbc6deb7bc6536c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125561fa-61db-4d8d-af48-b6b67d3f8ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125561fa-61db-4d8d-af48-b6b67d3f8ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae6d726-e496-406e-a037-5d9c828b3c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae6d726-e496-406e-a037-5d9c828b3c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ae556cf-d7db-4278-a613-e20fb5217ddd', 'volume_name': 'volume-6ae556cf-d7db-4278-a613-e20fb5217ddd', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc6c45a-c0b9-4cba-a8f7-30b84d238c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cc6c45a-c0b9-4cba-a8f7-30b84d238c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70eecac5-24b2-4564-8559-7509d4901b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:21 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume 6ae556cf-d7db-4278-a613-e20fb5217ddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ae556cf-d7db-4278-a613-e20fb5217ddd', 'volume_size': 1} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32097d7a-7aa0-4e61-bd8c-92fa1f847695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-640ba860-d746-4c42-be25-aeae5e252e1f', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9653e0f8-3f32-41d1-a403-11f69bd62ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a5f456-4b76-44c5-88bd-ff01407eca6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1000007069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26b3598d-8902-4895-8864-d71855c1d6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b98725d690450dab4f9f44a6941e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:43:20Z,use_quota=True,user_id='2f802c1e7c4f405dbbc6deb7bc6536c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca8a2d9-6109-4fc1-8857-eb3b24934867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca8a2d9-6109-4fc1-8857-eb3b24934867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889ef32f-48c7-4296-b28d-0a8822fbf856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889ef32f-48c7-4296-b28d-0a8822fbf856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26b3598d-8902-4895-8864-d71855c1d6ab', 'volume_name': 'volume-26b3598d-8902-4895-8864-d71855c1d6ab', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e729a72-57de-46a5-9a90-785a4d794ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e729a72-57de-46a5-9a90-785a4d794ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed191589-29aa-4196-a9e2-d04e96c69c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:21 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume 26b3598d-8902-4895-8864-d71855c1d6ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26b3598d-8902-4895-8864-d71855c1d6ab', 'volume_size': 1} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:21 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Flow 'volume_create_manager' (f2338e83-7968-4c5b-a934-24f2fe214c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:21 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553f8bbb-b1a9-4bfa-acf8-72de8651d97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-afef61e6-9d9b-4a3f-9ddf-979b620730e7 1073741824" returned: 0 in 0.665s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-afef61e6-9d9b-4a3f-9ddf-979b620730e7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:22 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume volume-640ba860-d746-4c42-be25-aeae5e252e1f (640ba860-d746-4c42-be25-aeae5e252e1f): created successfully Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9653e0f8-3f32-41d1-a403-11f69bd62ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Flow 'volume_create_manager' (ab284b2c-7288-47ec-995d-5110a1801127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:22 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-5e3ecbf1-a2a4-48b1-be18-d14495165318 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Created volume successfully. Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553f8bbb-b1a9-4bfa-acf8-72de8651d97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2034760916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b975a65-e05d-4ed7-9582-217600eff73d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b98725d690450dab4f9f44a6941e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:43:21Z,use_quota=True,user_id='2f802c1e7c4f405dbbc6deb7bc6536c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687de508-003b-4929-95b0-9e719946f75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687de508-003b-4929-95b0-9e719946f75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d319f641-d4a4-46d8-970e-c0a4626f8ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d319f641-d4a4-46d8-970e-c0a4626f8ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b975a65-e05d-4ed7-9582-217600eff73d', 'volume_name': 'volume-0b975a65-e05d-4ed7-9582-217600eff73d', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b24a27-d5c7-49b7-9ebe-9c336d8cb19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b24a27-d5c7-49b7-9ebe-9c336d8cb19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c34db75-e29b-48da-b580-9ef070859f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:22 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume 0b975a65-e05d-4ed7-9582-217600eff73d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b975a65-e05d-4ed7-9582-217600eff73d', 'volume_size': 1} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-afef61e6-9d9b-4a3f-9ddf-979b620730e7" returned: 0 in 0.680s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] <== create_volume: return (1376ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.069s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1212157393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae556cf-d7db-4278-a613-e20fb5217ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b98725d690450dab4f9f44a6941e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:43:19Z,use_quota=True,user_id='2f802c1e7c4f405dbbc6deb7bc6536c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Creating volume 6ae556cf-d7db-4278-a613-e20fb5217ddd {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:43:22 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:43:22 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6ae556cf-d7db-4278-a613-e20fb5217ddd 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:22 devstack quobyte-client[83313]: System call of process 100391 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:22 devstack quobyte-client[83313]: System call of process 100391 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:22 devstack quobyte-client[83313]: System call of process 100391 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:22 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=163, name=volume-6ae556cf-d7db-4278-a613-e20fb5217ddd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:43:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299a0406-0571-476f-b405-ab4625340ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afef61e6-9d9b-4a3f-9ddf-979b620730e7', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7673f588-2f38-447b-ae85-b3cfa6b4c46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6ae556cf-d7db-4278-a613-e20fb5217ddd 1073741824" returned: 0 in 0.525s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6ae556cf-d7db-4278-a613-e20fb5217ddd {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:23 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume volume-afef61e6-9d9b-4a3f-9ddf-979b620730e7 (afef61e6-9d9b-4a3f-9ddf-979b620730e7): created successfully Sep 22 11:43:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7673f588-2f38-447b-ae85-b3cfa6b4c46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:23 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Flow 'volume_create_manager' (c013ba04-094d-4090-b5db-7d893da525bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6ae556cf-d7db-4278-a613-e20fb5217ddd" returned: 0 in 0.389s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] <== create_volume: return (944ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:43:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.804s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1000007069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26b3598d-8902-4895-8864-d71855c1d6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b98725d690450dab4f9f44a6941e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:43:20Z,use_quota=True,user_id='2f802c1e7c4f405dbbc6deb7bc6536c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:43:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Creating volume 26b3598d-8902-4895-8864-d71855c1d6ab {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:43:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:23 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:43:23 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:43:23 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-26b3598d-8902-4895-8864-d71855c1d6ab 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:23 devstack quobyte-client[83313]: System call of process 100395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:23 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-17bae425-97a8-4ff2-82df-cf61632f6c38 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Created volume successfully. Sep 22 11:43:23 devstack quobyte-client[83313]: System call of process 100395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:23 devstack quobyte-client[83313]: System call of process 100395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:23 devstack quobyte-client[83313]: System call of process 100395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:23 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=164, name=volume-26b3598d-8902-4895-8864-d71855c1d6ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:43:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70eecac5-24b2-4564-8559-7509d4901b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ae556cf-d7db-4278-a613-e20fb5217ddd', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4702cff-7f4d-4f2e-b43c-40786c0f0b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-26b3598d-8902-4895-8864-d71855c1d6ab 1073741824" returned: 0 in 0.677s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-26b3598d-8902-4895-8864-d71855c1d6ab {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:24 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume volume-6ae556cf-d7db-4278-a613-e20fb5217ddd (6ae556cf-d7db-4278-a613-e20fb5217ddd): created successfully Sep 22 11:43:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4702cff-7f4d-4f2e-b43c-40786c0f0b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:24 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Flow 'volume_create_manager' (3f0b8467-9478-4d6a-b8bc-933e90cde0b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-26b3598d-8902-4895-8864-d71855c1d6ab" returned: 0 in 0.479s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] <== create_volume: return (1193ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:43:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.230s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2034760916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b975a65-e05d-4ed7-9582-217600eff73d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b98725d690450dab4f9f44a6941e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:43:21Z,use_quota=True,user_id='2f802c1e7c4f405dbbc6deb7bc6536c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:43:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Creating volume 0b975a65-e05d-4ed7-9582-217600eff73d {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:43:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:24 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:43:24 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:43:24 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0b975a65-e05d-4ed7-9582-217600eff73d 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:25 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-e396c3e4-4190-4fcd-9a97-7fa1d846cd76 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Created volume successfully. Sep 22 11:43:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed191589-29aa-4196-a9e2-d04e96c69c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26b3598d-8902-4895-8864-d71855c1d6ab', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99fdbc82-af22-43aa-88e7-9de2c9c1f1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:25 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=165, name=volume-0b975a65-e05d-4ed7-9582-217600eff73d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:43:25 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume volume-26b3598d-8902-4895-8864-d71855c1d6ab (26b3598d-8902-4895-8864-d71855c1d6ab): created successfully Sep 22 11:43:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99fdbc82-af22-43aa-88e7-9de2c9c1f1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:25 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Flow 'volume_create_manager' (b70ba98f-3a2b-4d32-b22d-6f1ba675b827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:25 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-e0309ea9-14f8-4b8d-b185-58cb68d5bfb2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Created volume successfully. Sep 22 11:43:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0b975a65-e05d-4ed7-9582-217600eff73d 1073741824" returned: 0 in 0.680s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0b975a65-e05d-4ed7-9582-217600eff73d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0b975a65-e05d-4ed7-9582-217600eff73d" returned: 0 in 0.142s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:25 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] <== create_volume: return (906ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:43:25 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c34db75-e29b-48da-b580-9ef070859f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b975a65-e05d-4ed7-9582-217600eff73d', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0027ba-c9e0-445e-9954-f68661bb2ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:26 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume volume-0b975a65-e05d-4ed7-9582-217600eff73d (0b975a65-e05d-4ed7-9582-217600eff73d): created successfully Sep 22 11:43:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0027ba-c9e0-445e-9954-f68661bb2ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:26 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Flow 'volume_create_manager' (f2338e83-7968-4c5b-a934-24f2fe214c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:26 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-b17a6de4-c2bd-4b45-a619-de3fbd4bd3f2 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Created volume successfully. Sep 22 11:43:27 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "cinder-0b975a65-e05d-4ed7-9582-217600eff73d-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:27 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-0b975a65-e05d-4ed7-9582-217600eff73d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:27 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:27 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "cinder-quobyte-0b975a65-e05d-4ed7-9582-217600eff73d" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:27 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-quobyte-0b975a65-e05d-4ed7-9582-217600eff73d" acquired by "delete_volume" :: waited 0.035s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:27 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[48afe455-ad19-4ac6-b58c-5c01ff757d7c]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:43:27 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0b975a65-e05d-4ed7-9582-217600eff73d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:28 devstack quobyte-client[83313]: System call of process 100406 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0b975a65-e05d-4ed7-9582-217600eff73d" returned: 0 in 0.679s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0b975a65-e05d-4ed7-9582-217600eff73d {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:28 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-0b975a65-e05d-4ed7-9582-217600eff73d" returned: 0 in 0.139s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:28 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-quobyte-0b975a65-e05d-4ed7-9582-217600eff73d" released by "delete_volume" :: held 1.036s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:29 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Created reservations ['4aae7655-b919-4b09-b064-9bd5f91c90d0', 'f576c668-5863-49bd-8efa-90ddb7b58356', '2c3955e4-08b5-4ff9-bb22-807531c99bcc', '2bd2e08b-fd9e-446b-8211-f5144aae5e9c'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:43:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:29 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:29 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.130s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:29 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:43:29 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Deleted volume successfully. Sep 22 11:43:29 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a59a98ac-bc13-47d7-b140-ba9c6838f354 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-0b975a65-e05d-4ed7-9582-217600eff73d-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:29 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "cinder-26b3598d-8902-4895-8864-d71855c1d6ab-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:30 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-26b3598d-8902-4895-8864-d71855c1d6ab-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:30 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:30 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "cinder-quobyte-26b3598d-8902-4895-8864-d71855c1d6ab" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:30 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-quobyte-26b3598d-8902-4895-8864-d71855c1d6ab" acquired by "delete_volume" :: waited 0.014s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:30 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[beddcc77-7f38-4bfc-b723-e56f1008b473]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:43:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-26b3598d-8902-4895-8864-d71855c1d6ab {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-26b3598d-8902-4895-8864-d71855c1d6ab" returned: 0 in 0.527s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-26b3598d-8902-4895-8864-d71855c1d6ab {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:30 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-26b3598d-8902-4895-8864-d71855c1d6ab" returned: 0 in 0.114s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:31 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-quobyte-26b3598d-8902-4895-8864-d71855c1d6ab" released by "delete_volume" :: held 0.859s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:31 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Created reservations ['6cf1ad25-8d64-4c27-ac9b-5a4eec62d660', '084ad2fa-6ab3-4821-a728-713874b53adc', 'ce177062-614e-4f2a-a839-7a46360f4b48', '46c70c95-6b17-4e08-908a-e7d9aeab60aa'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:43:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:31 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:31 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.122s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:31 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:43:31 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Deleted volume successfully. Sep 22 11:43:32 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-29987941-b947-4e6b-8aa2-8db4ef9026df tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-26b3598d-8902-4895-8864-d71855c1d6ab-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:32 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "cinder-6ae556cf-d7db-4278-a613-e20fb5217ddd-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:32 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-6ae556cf-d7db-4278-a613-e20fb5217ddd-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:32 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:32 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "cinder-quobyte-6ae556cf-d7db-4278-a613-e20fb5217ddd" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:32 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-quobyte-6ae556cf-d7db-4278-a613-e20fb5217ddd" acquired by "delete_volume" :: waited 0.012s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:32 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[104a6cad-6b47-46bb-911c-f0fb898a6c26]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:43:32 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6ae556cf-d7db-4278-a613-e20fb5217ddd {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6ae556cf-d7db-4278-a613-e20fb5217ddd" returned: 0 in 0.593s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6ae556cf-d7db-4278-a613-e20fb5217ddd {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:33 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-6ae556cf-d7db-4278-a613-e20fb5217ddd" returned: 0 in 0.123s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:33 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-quobyte-6ae556cf-d7db-4278-a613-e20fb5217ddd" released by "delete_volume" :: held 0.989s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:33 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Created reservations ['d447de2f-7b2d-47b0-b719-83a12345a6c8', 'a5f5c2aa-d9d0-4ecf-8c61-021b029f3c78', '8c5f1f53-ba10-438f-8966-fb66451d91af', '9aa1c3a2-c43f-4507-9864-a5edb1572445'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.120s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:43:34 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Deleted volume successfully. Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-e1b989f4-bd63-4a48-9876-1ddb87a5e2f8 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-6ae556cf-d7db-4278-a613-e20fb5217ddd-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:34 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Flow 'volume_create_manager' (2f3ad7a9-652c-4322-b066-106c3f336eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fbca225-a58e-4344-a034-a003dc1b0489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "cinder-afef61e6-9d9b-4a3f-9ddf-979b620730e7-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fbca225-a58e-4344-a034-a003dc1b0489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-817170039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8dc988e-b3b0-4513-829a-3f5f35515558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf93604263b4c698edcb95a69e4f920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:43:34Z,use_quota=True,user_id='490fe824d1ac4bad8cce8f112f9c4b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f81994-1a63-4f6f-802d-081917ca8e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f81994-1a63-4f6f-802d-081917ca8e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881eca7e-40dc-4ec9-aa3c-a6ce932493b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881eca7e-40dc-4ec9-aa3c-a6ce932493b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8dc988e-b3b0-4513-829a-3f5f35515558', 'volume_name': 'volume-e8dc988e-b3b0-4513-829a-3f5f35515558', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b602cfbd-6a83-4b6b-8885-30bb87d6307a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b602cfbd-6a83-4b6b-8885-30bb87d6307a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fdadf9-4cab-400a-837e-1520b3f1ad02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:34 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Volume e8dc988e-b3b0-4513-829a-3f5f35515558: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8dc988e-b3b0-4513-829a-3f5f35515558', 'volume_size': 1} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-817170039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8dc988e-b3b0-4513-829a-3f5f35515558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf93604263b4c698edcb95a69e4f920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:43:34Z,use_quota=True,user_id='490fe824d1ac4bad8cce8f112f9c4b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Creating volume e8dc988e-b3b0-4513-829a-3f5f35515558 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:43:34 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:43:34 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:35 devstack quobyte-client[83313]: System call of process 100421 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:35 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=166, name=volume-e8dc988e-b3b0-4513-829a-3f5f35515558, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:43:35 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-afef61e6-9d9b-4a3f-9ddf-979b620730e7-delete_volume" acquired by "delete_volume" :: waited 0.291s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558 1073741824" returned: 0 in 0.462s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558" returned: 0 in 0.362s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:35 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] <== create_volume: return (860ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:43:35 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:35 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:35 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "cinder-quobyte-afef61e6-9d9b-4a3f-9ddf-979b620730e7" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fdadf9-4cab-400a-837e-1520b3f1ad02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8dc988e-b3b0-4513-829a-3f5f35515558', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:35 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94ca9e8-fb5c-4dc1-b0f3-fc82c19c547e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:35 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-quobyte-afef61e6-9d9b-4a3f-9ddf-979b620730e7" acquired by "delete_volume" :: waited 0.116s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:36 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3ad775-b0f9-41e8-aee6-ee07ffd72a62]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:43:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-afef61e6-9d9b-4a3f-9ddf-979b620730e7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:36 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Volume volume-e8dc988e-b3b0-4513-829a-3f5f35515558 (e8dc988e-b3b0-4513-829a-3f5f35515558): created successfully Sep 22 11:43:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94ca9e8-fb5c-4dc1-b0f3-fc82c19c547e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:36 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Flow 'volume_create_manager' (2f3ad7a9-652c-4322-b066-106c3f336eff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:36 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-08dcab60-2f11-4a07-8650-c161135844e7 tempest-SnapshotDependencyTests-1569098433 None] Created volume successfully. Sep 22 11:43:36 devstack quobyte-client[83313]: System call of process 100426 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-afef61e6-9d9b-4a3f-9ddf-979b620730e7" returned: 0 in 0.560s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-afef61e6-9d9b-4a3f-9ddf-979b620730e7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:36 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-afef61e6-9d9b-4a3f-9ddf-979b620730e7" returned: 0 in 0.116s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:36 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-quobyte-afef61e6-9d9b-4a3f-9ddf-979b620730e7" released by "delete_volume" :: held 0.884s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:37 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:37 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Created reservations ['7e3fdf36-99b3-4f22-a4a1-b3737cb9c702', '3316b280-50a3-4e66-9b27-f44c9b91b3af', '09dfe32a-00a7-4182-bee8-0c0c17eb3986', '9989a470-28d9-4915-80d7-2cc417d70599'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:43:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] Creating offline snapshot 02c3cddf-9eda-4976-89a7-d44ebfb49073 of volume e8dc988e-b3b0-4513-829a-3f5f35515558 {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:43:37 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ebf20e-8277-4dc4-8481-b5abb951099f]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:43:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.032s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:37 devstack quobyte-client[83313]: System call of process 100430 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:37 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:37 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558" returned: 0 in 0.780s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.02c3cddf-9eda-4976-89a7-d44ebfb49073 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:38 devstack quobyte-client[83313]: System call of process 100434 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:38 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=167, name=volume-e8dc988e-b3b0-4513-829a-3f5f35515558.02c3cddf-9eda-4976-89a7-d44ebfb49073, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:43:38 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "cinder-640ba860-d746-4c42-be25-aeae5e252e1f-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.580s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:38 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:43:38 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Deleted volume successfully. Sep 22 11:43:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.02c3cddf-9eda-4976-89a7-d44ebfb49073 1G" returned: 0 in 0.525s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:38 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e8dc988e-b3b0-4513-829a-3f5f35515558 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.02c3cddf-9eda-4976-89a7-d44ebfb49073 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:38 devstack quobyte-client[83313]: System call of process 100437 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:38 devstack quobyte-client[83313]: System call of process 100437 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:38 devstack quobyte-client[83313]: System call of process 100437 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:38 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-640ba860-d746-4c42-be25-aeae5e252e1f-delete_volume" acquired by "delete_volume" :: waited 0.419s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] CMD "qemu-img rebase -u -b volume-e8dc988e-b3b0-4513-829a-3f5f35515558 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.02c3cddf-9eda-4976-89a7-d44ebfb49073" returned: 0 in 0.393s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.02c3cddf-9eda-4976-89a7-d44ebfb49073 is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:43:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.02c3cddf-9eda-4976-89a7-d44ebfb49073 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-dee7cb2d-be09-495f-8ef2-073ac3f2545a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-afef61e6-9d9b-4a3f-9ddf-979b620730e7-delete_volume" released by "delete_volume" :: held 4.096s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.02c3cddf-9eda-4976-89a7-d44ebfb49073" returned: 0 in 0.399s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:39 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558 -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:43:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.02c3cddf-9eda-4976-89a7-d44ebfb49073 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:39 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "cinder-quobyte-640ba860-d746-4c42-be25-aeae5e252e1f" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.02c3cddf-9eda-4976-89a7-d44ebfb49073" returned: 0 in 0.238s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:39 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:39 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-quobyte-640ba860-d746-4c42-be25-aeae5e252e1f" acquired by "delete_volume" :: waited 0.205s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:40 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[238645d1-11d9-41d9-ac0c-9001e89c811d]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:43:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-640ba860-d746-4c42-be25-aeae5e252e1f {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.info" returned: 0 in 0.276s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:40 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:43:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.info" returned: 0 in 0.145s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.022s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:40 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-1a637268-8d8c-489d-96df-09216bb321e6 tempest-SnapshotDependencyTests-1569098433 None] Create snapshot completed successfully Sep 22 11:43:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-640ba860-d746-4c42-be25-aeae5e252e1f" returned: 0 in 0.632s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-640ba860-d746-4c42-be25-aeae5e252e1f {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:40 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-640ba860-d746-4c42-be25-aeae5e252e1f" returned: 0 in 0.143s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:40 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-quobyte-640ba860-d746-4c42-be25-aeae5e252e1f" released by "delete_volume" :: held 0.965s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:41 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Created reservations ['1330144a-88a6-43f5-b343-5c6edd17128b', 'c7c724fa-64f9-40b8-9287-546cad09a208', '2a998806-be0f-47ad-af43-5b2e530fc060', '93955fe3-5fb5-4401-9506-60b6c179ce10'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:43:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:41 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:41 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.166s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:41 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:43:41 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Deleted volume successfully. Sep 22 11:43:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-3eeb2811-e4f1-45e7-85cb-649fb25ddc4a tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-640ba860-d746-4c42-be25-aeae5e252e1f-delete_volume" released by "delete_volume" :: held 2.803s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "cinder-b520e65c-f8cd-4b64-abd1-fcadb0408cd7-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:41 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-b520e65c-f8cd-4b64-abd1-fcadb0408cd7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:42 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:42 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "cinder-quobyte-b520e65c-f8cd-4b64-abd1-fcadb0408cd7" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:42 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-quobyte-b520e65c-f8cd-4b64-abd1-fcadb0408cd7" acquired by "delete_volume" :: waited 0.017s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:42 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da3136e-f3bc-4094-88ec-445f3e74528b]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:43:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b520e65c-f8cd-4b64-abd1-fcadb0408cd7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:42 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:42 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:43:42 devstack quobyte-client[83313]: System call of process 100449 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:42 devstack quobyte-client[83313]: System call of process 100449 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Flow 'volume_create_manager' (981901ba-f1b8-4b29-8648-86f7a5e62748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75da8d4f-25f3-4664-8a6a-284831340f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75da8d4f-25f3-4664-8a6a-284831340f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55de1472-1b98-45f5-a052-5829e7cc56dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf93604263b4c698edcb95a69e4f920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=02c3cddf-9eda-4976-89a7-d44ebfb49073,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:43:42Z,use_quota=True,user_id='490fe824d1ac4bad8cce8f112f9c4b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca67514-d652-42ba-8bae-2624bf659912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca67514-d652-42ba-8bae-2624bf659912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e1ee6a-80fd-48b7-99f8-8b450c4e8086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e1ee6a-80fd-48b7-99f8-8b450c4e8086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '55de1472-1b98-45f5-a052-5829e7cc56dc', 'volume_name': 'volume-55de1472-1b98-45f5-a052-5829e7cc56dc', 'volume_size': 1, 'snapshot_id': '02c3cddf-9eda-4976-89a7-d44ebfb49073'}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce69198-0da2-4630-b34d-30703164f722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce69198-0da2-4630-b34d-30703164f722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:42 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c0407d-1fa2-4e95-ba44-240548849d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:42 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Volume 55de1472-1b98-45f5-a052-5829e7cc56dc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-55de1472-1b98-45f5-a052-5829e7cc56dc', 'volume_size': 1, 'snapshot_id': '02c3cddf-9eda-4976-89a7-d44ebfb49073'} Sep 22 11:43:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b520e65c-f8cd-4b64-abd1-fcadb0408cd7" returned: 0 in 0.715s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:42 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b520e65c-f8cd-4b64-abd1-fcadb0408cd7 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.026s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Acquiring lock "cinder-quobyte-02c3cddf-9eda-4976-89a7-d44ebfb49073-55de1472-1b98-45f5-a052-5829e7cc56dc" by "_create_volume_from_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-b520e65c-f8cd-4b64-abd1-fcadb0408cd7" returned: 0 in 0.351s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-quobyte-b520e65c-f8cd-4b64-abd1-fcadb0408cd7" released by "delete_volume" :: held 1.166s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Lock "cinder-quobyte-02c3cddf-9eda-4976-89a7-d44ebfb49073-55de1472-1b98-45f5-a052-5829e7cc56dc" acquired by "_create_volume_from_snapshot" :: waited 0.143s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Creating volume 55de1472-1b98-45f5-a052-5829e7cc56dc from snapshot 02c3cddf-9eda-4976-89a7-d44ebfb49073 {{(pid=83310) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Acquiring lock "cinder-quobyte-55de1472-1b98-45f5-a052-5829e7cc56dc" by "_copy_volume_from_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Lock "cinder-quobyte-55de1472-1b98-45f5-a052-5829e7cc56dc" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] snapshot: 02c3cddf-9eda-4976-89a7-d44ebfb49073, volume: 55de1472-1b98-45f5-a052-5829e7cc56dc, {{(pid=83310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f381804a-e08e-48b3-9c77-c7994b4b659d]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.02c3cddf-9eda-4976-89a7-d44ebfb49073 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Created reservations ['b6aa2491-0f86-42f2-b45d-571d9528fab2', '338c24cc-22bc-472d-bf4f-a1f3fc519138', '2f0c7a14-8736-43a1-9dc3-c27647141493', '291d444e-175a-4aa5-8318-cedf6df5f389'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:43 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.02c3cddf-9eda-4976-89a7-d44ebfb49073" returned: 0 in 0.643s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8dc988e-b3b0-4513-829a-3f5f35515558(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:43:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558 {{(pid=83310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 22 11:43:44 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Creating direct copy from snapshot {{(pid=83310) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 22 11:43:44 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c532e9-83db-4865-b351-b82e42a39b10]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:43:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.370s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:44 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:43:44 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Deleted volume successfully. Sep 22 11:43:44 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-ad126a45-95b3-4c5c-9671-826818f4baf3 tempest-CreateVolumesFromSourceVolumeTest-2048483692 None] Lock "cinder-b520e65c-f8cd-4b64-abd1-fcadb0408cd7-delete_volume" released by "delete_volume" :: held 2.942s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:44 devstack quobyte-client[83313]: System call of process 100458 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558" returned: 0 in 0.642s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:44 devstack cinder-volume[83310]: DEBUG cinder.utils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-55de1472-1b98-45f5-a052-5829e7cc56dc not found in is_blk_device check {{(pid=83310) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 22 11:43:44 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-55de1472-1b98-45f5-a052-5829e7cc56dc {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:45 devstack quobyte-client[83313]: System call of process 100461 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:45 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=169, name=volume-55de1472-1b98-45f5-a052-5829e7cc56dc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:43:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-55de1472-1b98-45f5-a052-5829e7cc56dc" returned: 0 in 6.434s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:51 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6b4f8d-5a05-4a60-9d64-ca8faf369101]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:43:51 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:51 devstack quobyte-client[83313]: System call of process 100475 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:52 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Flow 'volume_create_manager' (886b2e76-4b00-44ba-9cf7-f9f7c012a096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b208b4-d815-4abb-a7e0-710bfe09414e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558" returned: 0 in 0.979s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.image.image_utils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Image conversion details: src /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558, size 1024.00 MB, duration 6.46 sec, destination /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-55de1472-1b98-45f5-a052-5829e7cc56dc {{(pid=83310) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 22 11:43:52 devstack cinder-volume[83310]: INFO cinder.image.image_utils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Converted 1024.00 MB image at 158.43 MB/s Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-55de1472-1b98-45f5-a052-5829e7cc56dc is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-55de1472-1b98-45f5-a052-5829e7cc56dc {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b208b4-d815-4abb-a7e0-710bfe09414e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414796d4-c189-4d66-9458-3bdd06abe1f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492d608349e04647a66a0adb2c7e8c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:43:52Z,use_quota=True,user_id='d9fd2e73a6e24a11bfe281b55e73ce8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a702fb82-f4db-49f0-9b41-5b8e675cffaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a702fb82-f4db-49f0-9b41-5b8e675cffaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3508a3-0107-4b6d-8a9c-4071f88c736d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3508a3-0107-4b6d-8a9c-4071f88c736d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414796d4-c189-4d66-9458-3bdd06abe1f2', 'volume_name': 'volume-414796d4-c189-4d66-9458-3bdd06abe1f2', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de95e4bb-ee81-42e2-9f82-efa3b3a7b1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de95e4bb-ee81-42e2-9f82-efa3b3a7b1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98c2c2e-be86-4cae-89af-90061b283096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:52 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Volume 414796d4-c189-4d66-9458-3bdd06abe1f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414796d4-c189-4d66-9458-3bdd06abe1f2', 'volume_size': 1} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-55de1472-1b98-45f5-a052-5829e7cc56dc" returned: 0 in 0.372s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Lock "cinder-quobyte-55de1472-1b98-45f5-a052-5829e7cc56dc" released by "_copy_volume_from_snapshot" :: held 9.557s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Lock "cinder-quobyte-02c3cddf-9eda-4976-89a7-d44ebfb49073-55de1472-1b98-45f5-a052-5829e7cc56dc" released by "_create_volume_from_snapshot" :: held 9.639s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.797s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.178s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414796d4-c189-4d66-9458-3bdd06abe1f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492d608349e04647a66a0adb2c7e8c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:43:52Z,use_quota=True,user_id='d9fd2e73a6e24a11bfe281b55e73ce8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Creating volume 414796d4-c189-4d66-9458-3bdd06abe1f2 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:43:52 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:43:52 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-414796d4-c189-4d66-9458-3bdd06abe1f2 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:53 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=170, name=volume-414796d4-c189-4d66-9458-3bdd06abe1f2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:43:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-414796d4-c189-4d66-9458-3bdd06abe1f2 1073741824" returned: 0 in 0.573s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-414796d4-c189-4d66-9458-3bdd06abe1f2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:53 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c0407d-1fa2-4e95-ba44-240548849d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55de1472-1b98-45f5-a052-5829e7cc56dc', 'volume_size': 1, 'snapshot_id': '02c3cddf-9eda-4976-89a7-d44ebfb49073'}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:53 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e645442-fc55-492f-b7cb-a990b7d0efc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:53 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-414796d4-c189-4d66-9458-3bdd06abe1f2" returned: 0 in 0.406s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:54 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Volume volume-55de1472-1b98-45f5-a052-5829e7cc56dc (55de1472-1b98-45f5-a052-5829e7cc56dc): created successfully Sep 22 11:43:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e645442-fc55-492f-b7cb-a990b7d0efc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Flow 'volume_create_manager' (981901ba-f1b8-4b29-8648-86f7a5e62748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:54 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] <== create_volume: return (1099ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:43:54 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98c2c2e-be86-4cae-89af-90061b283096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414796d4-c189-4d66-9458-3bdd06abe1f2', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87386c35-8413-49b0-8673-5844614cb2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:54 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-5b343af0-d696-44de-8514-e8b7a0ca7d97 tempest-SnapshotDependencyTests-1569098433 None] Created volume successfully. Sep 22 11:43:54 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Volume volume-414796d4-c189-4d66-9458-3bdd06abe1f2 (414796d4-c189-4d66-9458-3bdd06abe1f2): created successfully Sep 22 11:43:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87386c35-8413-49b0-8673-5844614cb2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:54 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Flow 'volume_create_manager' (886b2e76-4b00-44ba-9cf7-f9f7c012a096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:54 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-f59c35b5-3655-4dbd-a344-a266f8fc3442 tempest-CinderUnicodeTest-127319059 None] Created volume successfully. Sep 22 11:43:54 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] Acquiring lock "cinder-02c3cddf-9eda-4976-89a7-d44ebfb49073-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] Lock "cinder-02c3cddf-9eda-4976-89a7-d44ebfb49073-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:55 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] Acquiring lock "cinder-quobyte-e8dc988e-b3b0-4513-829a-3f5f35515558" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] Lock "cinder-quobyte-e8dc988e-b3b0-4513-829a-3f5f35515558" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] Acquiring lock "cinder-quobyte-02c3cddf-9eda-4976-89a7-d44ebfb49073" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:55 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] Lock "cinder-quobyte-02c3cddf-9eda-4976-89a7-d44ebfb49073" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:55 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] Deleting offline snapshot 02c3cddf-9eda-4976-89a7-d44ebfb49073 of volume e8dc988e-b3b0-4513-829a-3f5f35515558 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:43:55 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] snapshot_file for this snap is: volume-e8dc988e-b3b0-4513-829a-3f5f35515558.02c3cddf-9eda-4976-89a7-d44ebfb49073 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:43:55 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[feea86f3-ad92-4312-a510-b684f8cef9c7]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:43:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.02c3cddf-9eda-4976-89a7-d44ebfb49073 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.02c3cddf-9eda-4976-89a7-d44ebfb49073" returned: 0 in 0.482s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:55 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8dc988e-b3b0-4513-829a-3f5f35515558(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:43:55 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[941e5645-4686-41e7-9815-4e203723d236]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:43:55 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:56 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG cinder.volume.flows.manager.create_volume [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83310) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Flow 'volume_create_manager' (92de1843-8b25-4db6-9b66-5cd7d25f9be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3bcb4d-44f3-4384-aa43-b7183d0009dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558" returned: 0 in 0.703s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3bcb4d-44f3-4384-aa43-b7183d0009dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:43:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-456819462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a56e796-3cfc-4a56-a550-1f0010126f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492d608349e04647a66a0adb2c7e8c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:43:56Z,use_quota=True,user_id='d9fd2e73a6e24a11bfe281b55e73ce8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8681a971-fe67-4a21-8027-365f6d436942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8681a971-fe67-4a21-8027-365f6d436942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949c6161-c8fd-4d44-bb84-60b0dbf3ff7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949c6161-c8fd-4d44-bb84-60b0dbf3ff7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a56e796-3cfc-4a56-a550-1f0010126f71', 'volume_name': 'volume-2a56e796-3cfc-4a56-a550-1f0010126f71', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d55f9f-266f-4d5c-8f15-627a9473eb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d55f9f-266f-4d5c-8f15-627a9473eb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f18668e-3ff8-4918-a6b4-19c8019b46be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:56 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Volume 2a56e796-3cfc-4a56-a550-1f0010126f71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a56e796-3cfc-4a56-a550-1f0010126f71', 'volume_size': 1} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-22T09:43:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-456819462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a56e796-3cfc-4a56-a550-1f0010126f71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492d608349e04647a66a0adb2c7e8c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-22T09:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-22T09:43:56Z,use_quota=True,user_id='d9fd2e73a6e24a11bfe281b55e73ce8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3252170-2cd8-4f04-b181-2cd02f6e2cbb),volume_type_id=e3252170-2cd8-4f04-b181-2cd02f6e2cbb)}" {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Creating volume 2a56e796-3cfc-4a56-a550-1f0010126f71 {{(pid=83310) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Selected 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c as target Quobyte volume. {{(pid=83310) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 22 11:43:56 devstack cinder-volume[83310]: INFO cinder.volume.drivers.remotefs [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] casted to 10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71 1073741824 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.02c3cddf-9eda-4976-89a7-d44ebfb49073 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:56 devstack quobyte-client[83313]: System call of process 100491 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:56 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=171, name=volume-2a56e796-3cfc-4a56-a550-1f0010126f71, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:43:56 devstack quobyte-client[83313]: System call of process 100494 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71 1073741824" returned: 0 in 0.486s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:56 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.02c3cddf-9eda-4976-89a7-d44ebfb49073" returned: 0 in 0.494s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.02c3cddf-9eda-4976-89a7-d44ebfb49073 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71" returned: 0 in 0.193s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:57 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] <== create_volume: return (774ms) {'provider_location': '10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'} {{(pid=83310) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 22 11:43:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:43:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f18668e-3ff8-4918-a6b4-19c8019b46be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a56e796-3cfc-4a56-a550-1f0010126f71', 'volume_size': 1}' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e65da4-9086-4184-bfa7-8420cce1d580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 22 11:43:57 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558.02c3cddf-9eda-4976-89a7-d44ebfb49073" returned: 0 in 0.376s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] Lock "cinder-quobyte-02c3cddf-9eda-4976-89a7-d44ebfb49073" released by "_delete_snapshot" :: held 2.510s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:57 devstack cinder-volume[83310]: INFO cinder.volume.flows.manager.create_volume [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Volume volume-2a56e796-3cfc-4a56-a550-1f0010126f71 (2a56e796-3cfc-4a56-a550-1f0010126f71): created successfully Sep 22 11:43:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e65da4-9086-4184-bfa7-8420cce1d580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83310) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 22 11:43:57 devstack cinder-volume[83310]: DEBUG cinder.volume.manager [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Flow 'volume_create_manager' (92de1843-8b25-4db6-9b66-5cd7d25f9be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83310) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 22 11:43:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] Lock "cinder-quobyte-e8dc988e-b3b0-4513-829a-3f5f35515558" released by "delete_snapshot" :: held 2.561s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:57 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-31b0010f-ef92-47c0-9db7-8bdb8e08968e tempest-CinderUnicodeTest-127319059 None] Created volume successfully. Sep 22 11:43:57 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] Created reservations ['4da7d2c0-da92-4fd8-9dad-6dd29bac3420', '2b9c3eea-a49d-4439-9cf2-dd613195a063', '46441c6a-efd0-48d5-9a3d-e260b8ad4559', '5108b37c-355d-431d-9e81-5060ab66e36c'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:43:57 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] Delete snapshot completed successfully. Sep 22 11:43:57 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-2bb68692-6f15-4753-a778-791371ce54a0 tempest-SnapshotDependencyTests-1569098433 None] Lock "cinder-02c3cddf-9eda-4976-89a7-d44ebfb49073-delete_snapshot" released by "delete_snapshot" :: held 2.859s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] Acquiring lock "cinder-e8dc988e-b3b0-4513-829a-3f5f35515558-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] Lock "cinder-e8dc988e-b3b0-4513-829a-3f5f35515558-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:58 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] Acquiring lock "cinder-quobyte-e8dc988e-b3b0-4513-829a-3f5f35515558" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:43:58 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] Lock "cinder-quobyte-e8dc988e-b3b0-4513-829a-3f5f35515558" acquired by "delete_volume" :: waited 0.019s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:43:58 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3076109-90f9-47cf-9025-acda2c62e964]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:43:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:58 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:43:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:43:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:43:58 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] Creating offline snapshot f634f63a-76b6-4307-a8fd-bd95a2306e4a of volume 2a56e796-3cfc-4a56-a550-1f0010126f71 {{(pid=83310) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 22 11:43:58 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ca45c2-c42a-4b44-9128-c39095f9d463]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:43:58 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:58 devstack quobyte-client[83313]: System call of process 100499 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558" returned: 0 in 0.655s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-e8dc988e-b3b0-4513-829a-3f5f35515558" returned: 0 in 0.110s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:59 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] Lock "cinder-quobyte-e8dc988e-b3b0-4513-829a-3f5f35515558" released by "delete_volume" :: held 0.999s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:43:59 devstack quobyte-client[83313]: System call of process 100500 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:59 devstack quobyte-client[83313]: System call of process 100500 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:59 devstack quobyte-client[83313]: System call of process 100500 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71" returned: 0 in 0.782s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:43:59 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.f634f63a-76b6-4307-a8fd-bd95a2306e4a 1G {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:43:59 devstack quobyte-client[83313]: System call of process 100510 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:43:59 devstack quobyte-client[83313]: The server volume:c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=c1d9f7e0-dcd7-456e-ab8b-b8799cea2ae6, inode=172, name=volume-2a56e796-3cfc-4a56-a550-1f0010126f71.f634f63a-76b6-4307-a8fd-bd95a2306e4a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.214), requestorAccessMask=0 Sep 22 11:44:00 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] Created reservations ['758a0806-86b0-4252-b228-f3513a7433f6', '32ff3f25-22b4-4787-8b4f-7336a6d74fdb', 'a833863f-d7de-49e2-9576-1ef7d63e3cef', 'fa3fd48c-ef5f-48e3-8643-78a5581a5e78'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:44:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.f634f63a-76b6-4307-a8fd-bd95a2306e4a 1G" returned: 0 in 0.440s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2a56e796-3cfc-4a56-a550-1f0010126f71 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.f634f63a-76b6-4307-a8fd-bd95a2306e4a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:00 devstack quobyte-client[83313]: System call of process 100520 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:44:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:44:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:44:00 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:44:00 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:44:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:44:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:00 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] CMD "qemu-img rebase -u -b volume-2a56e796-3cfc-4a56-a550-1f0010126f71 -F qcow2 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.f634f63a-76b6-4307-a8fd-bd95a2306e4a" returned: 0 in 0.748s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:00 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] Acquiring lock "cinder-55de1472-1b98-45f5-a052-5829e7cc56dc-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:44:01 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.f634f63a-76b6-4307-a8fd-bd95a2306e4a is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:44:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.f634f63a-76b6-4307-a8fd-bd95a2306e4a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.f634f63a-76b6-4307-a8fd-bd95a2306e4a" returned: 0 in 0.230s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:01 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] Setting permissions: /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71 -> 1000:1000 {{(pid=83310) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 22 11:44:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.f634f63a-76b6-4307-a8fd-bd95a2306e4a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.764s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:01 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] Lock "cinder-55de1472-1b98-45f5-a052-5829e7cc56dc-delete_volume" acquired by "delete_volume" :: waited 0.564s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:44:01 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:44:01 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] Deleted volume successfully. Sep 22 11:44:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.f634f63a-76b6-4307-a8fd-bd95a2306e4a" returned: 0 in 0.471s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:01 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:02 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:44:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] Acquiring lock "cinder-quobyte-55de1472-1b98-45f5-a052-5829e7cc56dc" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:44:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-abedc681-c42b-47d9-9e8f-303b153873c1 tempest-SnapshotDependencyTests-1569098433 None] Lock "cinder-e8dc988e-b3b0-4513-829a-3f5f35515558-delete_volume" released by "delete_volume" :: held 3.904s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:44:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.info" returned: 0 in 0.434s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:02 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] File path /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.info is being set with permissions: 660 {{(pid=83310) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 22 11:44:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.info {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.info" returned: 0 in 0.156s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.721s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:44:02 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] Lock "cinder-quobyte-55de1472-1b98-45f5-a052-5829e7cc56dc" acquired by "delete_volume" :: waited 0.433s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:44:02 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e484966-f4a8-4488-813d-1c7f6235437f]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:44:02 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-55de1472-1b98-45f5-a052-5829e7cc56dc {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:02 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-b1eb909f-61cf-496b-89ab-af43d013bd39 tempest-CinderUnicodeTest-127319059 None] Create snapshot completed successfully Sep 22 11:44:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-55de1472-1b98-45f5-a052-5829e7cc56dc" returned: 0 in 0.491s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-55de1472-1b98-45f5-a052-5829e7cc56dc {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-55de1472-1b98-45f5-a052-5829e7cc56dc" returned: 0 in 0.100s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] Lock "cinder-quobyte-55de1472-1b98-45f5-a052-5829e7cc56dc" released by "delete_volume" :: held 0.802s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:44:03 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] Created reservations ['c2755c95-1d60-46fb-81da-3955e584de17', '64dc4d39-cc1c-4f87-84dd-ce895a29e5b4', 'fa686fe4-7e57-4d36-9d3f-a6b0504abc12', 'be7cf5b2-f033-46e3-a445-6aaae50086b0'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:44:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] Acquiring lock "cinder-f634f63a-76b6-4307-a8fd-bd95a2306e4a-delete_snapshot" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:44:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] Lock "cinder-f634f63a-76b6-4307-a8fd-bd95a2306e4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:44:03 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:44:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] Acquiring lock "cinder-quobyte-2a56e796-3cfc-4a56-a550-1f0010126f71" by "delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:44:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] Lock "cinder-quobyte-2a56e796-3cfc-4a56-a550-1f0010126f71" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:44:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] Acquiring lock "cinder-quobyte-f634f63a-76b6-4307-a8fd-bd95a2306e4a" by "_delete_snapshot" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:44:03 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] Lock "cinder-quobyte-f634f63a-76b6-4307-a8fd-bd95a2306e4a" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:44:03 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] Deleting offline snapshot f634f63a-76b6-4307-a8fd-bd95a2306e4a of volume 2a56e796-3cfc-4a56-a550-1f0010126f71 {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 22 11:44:03 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] snapshot_file for this snap is: volume-2a56e796-3cfc-4a56-a550-1f0010126f71.f634f63a-76b6-4307-a8fd-bd95a2306e4a {{(pid=83310) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 22 11:44:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:44:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:44:03 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:44:03 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:44:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:44:03 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:04 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f207e4-ac5f-4934-bda6-80ba64c414f7]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:44:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.f634f63a-76b6-4307-a8fd-bd95a2306e4a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.332s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:04 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:44:04 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] Deleted volume successfully. Sep 22 11:44:04 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-69a8a07e-1b42-46de-9ab4-25a58bf46826 tempest-SnapshotDependencyTests-1569098433 None] Lock "cinder-55de1472-1b98-45f5-a052-5829e7cc56dc-delete_volume" released by "delete_volume" :: held 3.177s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:44:04 devstack quobyte-client[83313]: System call of process 100560 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:44:04 devstack quobyte-client[83313]: System call of process 100560 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:44:04 devstack quobyte-client[83313]: System call of process 100560 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:44:04 devstack quobyte-client[83313]: System call of process 100560 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:44:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.f634f63a-76b6-4307-a8fd-bd95a2306e4a" returned: 0 in 0.642s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:04 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.remotefs [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a56e796-3cfc-4a56-a550-1f0010126f71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83310) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 22 11:44:04 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c83493-b546-4b91-a06b-cc3c282c92b8]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:44:04 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71" returned: 0 in 0.575s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.f634f63a-76b6-4307-a8fd-bd95a2306e4a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:05 devstack quobyte-client[83313]: System call of process 100567 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:44:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.f634f63a-76b6-4307-a8fd-bd95a2306e4a" returned: 0 in 0.252s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.f634f63a-76b6-4307-a8fd-bd95a2306e4a {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:05 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71.f634f63a-76b6-4307-a8fd-bd95a2306e4a" returned: 0 in 0.104s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:06 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] Lock "cinder-quobyte-f634f63a-76b6-4307-a8fd-bd95a2306e4a" released by "_delete_snapshot" :: held 2.103s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:44:06 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] Lock "cinder-quobyte-2a56e796-3cfc-4a56-a550-1f0010126f71" released by "delete_snapshot" :: held 2.129s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:44:06 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] Created reservations ['45a1e5dc-ab46-456b-bb75-d56b6848ffbf', '3dc2b28b-756d-4aa6-9143-fedcf63b634b', '820eaea3-c821-48d3-bb33-615ed671b00b', 'dc839250-87aa-4191-a0d4-7faf5855dba1'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:44:06 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] Delete snapshot completed successfully. Sep 22 11:44:06 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-efe36f42-a229-4388-ae21-454c3445a473 tempest-CinderUnicodeTest-127319059 None] Lock "cinder-f634f63a-76b6-4307-a8fd-bd95a2306e4a-delete_snapshot" released by "delete_snapshot" :: held 2.745s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:44:07 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] Acquiring lock "cinder-2a56e796-3cfc-4a56-a550-1f0010126f71-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:44:07 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] Lock "cinder-2a56e796-3cfc-4a56-a550-1f0010126f71-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:44:07 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:44:07 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] Acquiring lock "cinder-quobyte-2a56e796-3cfc-4a56-a550-1f0010126f71" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:44:07 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] Lock "cinder-quobyte-2a56e796-3cfc-4a56-a550-1f0010126f71" acquired by "delete_volume" :: waited 0.011s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:44:07 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdab2894-cd19-4125-928b-8a9d14de444f]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:44:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71" returned: 0 in 0.470s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:07 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-2a56e796-3cfc-4a56-a550-1f0010126f71" returned: 0 in 0.115s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:08 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] Lock "cinder-quobyte-2a56e796-3cfc-4a56-a550-1f0010126f71" released by "delete_volume" :: held 0.830s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:44:08 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] Created reservations ['7246f3f1-9402-4678-9a53-e3d3e1f08277', 'a8e365a0-19c9-4c72-b8cc-14e4e0442dfe', 'a5b12f5a-97c8-4f8b-bc57-722f462b48ca', 'f56d8021-9e3f-4c4e-8959-5fd80efe9d5c'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:44:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:44:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:44:08 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:44:08 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:44:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:44:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:08 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.175s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:08 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:44:09 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] Deleted volume successfully. Sep 22 11:44:09 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=75,cinder:INSERT=30,cinder:UPDATE=118,cinder:DELETE=9 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:44:09 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-a60eb731-0aa4-4ecc-9eec-73650a9573ef tempest-CinderUnicodeTest-127319059 None] Lock "cinder-2a56e796-3cfc-4a56-a550-1f0010126f71-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:44:09 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] Acquiring lock "cinder-414796d4-c189-4d66-9458-3bdd06abe1f2-delete_volume" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:44:09 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] Lock "cinder-414796d4-c189-4d66-9458-3bdd06abe1f2-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:44:09 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=73,cinder:UPDATE=108,cinder:DELETE=13,cinder:INSERT=18 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:44:09 devstack cinder-volume[83310]: WARNING cinder.volume.volume_utils [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 22 11:44:09 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] Acquiring lock "cinder-quobyte-414796d4-c189-4d66-9458-3bdd06abe1f2" by "delete_volume" {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 22 11:44:09 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] Lock "cinder-quobyte-414796d4-c189-4d66-9458-3bdd06abe1f2" acquired by "delete_volume" :: waited 0.021s {{(pid=83310) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 22 11:44:09 devstack cinder-volume[83310]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fac4e9-931f-417d-9ad0-a3bbd9899209]: (4, 'qcow2') {{(pid=84420) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 22 11:44:09 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-414796d4-c189-4d66-9458-3bdd06abe1f2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:10 devstack quobyte-client[83313]: System call of process 100578 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 22 11:44:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-414796d4-c189-4d66-9458-3bdd06abe1f2" returned: 0 in 0.530s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-414796d4-c189-4d66-9458-3bdd06abe1f2 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:10 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] CMD "rm -f /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733/volume-414796d4-c189-4d66-9458-3bdd06abe1f2" returned: 0 in 0.198s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:10 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] Lock "cinder-quobyte-414796d4-c189-4d66-9458-3bdd06abe1f2" released by "delete_volume" :: held 0.956s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:44:11 devstack cinder-volume[83310]: DEBUG cinder.quota [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] Created reservations ['99a6e203-94f4-424c-987d-a8a55ffddae8', 'a145b59f-3241-4d13-a93b-8063b6d0c014', '53d61919-0861-4ef7-85f2-fcf1320dca22', '6447223f-9213-4d72-be83-4728f828adbe'] {{(pid=83310) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 22 11:44:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:44:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:44:11 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:44:11 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:44:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:44:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:11 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.105s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:11 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:44:11 devstack cinder-volume[83310]: INFO cinder.volume.manager [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] Deleted volume successfully. Sep 22 11:44:11 devstack cinder-volume[83310]: DEBUG cinder.coordination [None req-c7651a24-7705-42cc-8757-746716aa5f6e tempest-CinderUnicodeTest-127319059 None] Lock "cinder-414796d4-c189-4d66-9458-3bdd06abe1f2-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=83310) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 22 11:44:18 devstack cinder-volume[83310]: DEBUG oslo_service.periodic_task [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83310) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 22 11:44:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 22 11:44:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 22 11:44:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c': None} {{(pid=83310) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 22 11:44:18 devstack cinder-volume[83310]: DEBUG cinder.volume.drivers.quobyte [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Available shares ['10.10.41.181/cinder-vol-1debeacd-cf42-40c0-a769-9cb31e49de1c'] {{(pid=83310) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 22 11:44:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.lockutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83310) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 22 11:44:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733 {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 22 11:44:18 devstack cinder-volume[83310]: DEBUG oslo_concurrency.processutils [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a66befa6d3c2df434264d5d1b2986733" returned: 0 in 0.134s {{(pid=83310) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 22 11:44:18 devstack cinder-volume[83310]: DEBUG cinder.manager [None req-7c186c75-00e6-41c2-904e-81b869a0561e None None] Notifying Schedulers of capabilities ... {{(pid=83310) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 22 11:44:21 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 22 11:44:21 devstack cinder-volume[83310]: DEBUG dbcounter [-] [83310] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83310) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}